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_ The system composed of species of living organisms and their en- 
vironment evolves under a stream of available energy from the sun. The 
differential survival of the components depends on the degree of success 
of each in securing its share of energy from this stream. 

This type of problem is familiar from the study of physicochemical 
systems in which the distribution and change in distribution of matter 
among specified components is examined in its relation to parameters 
of state. But whereas it is characteristic of physicochemical systems 
commonly considered that structure and mechanism play at most a sub- 
ordinate roie, in the study of organic evolution the structure and me- 
chanical properties of the components, on which their aptitude for cap- 
turing energy depends, play the dominant role. 


If we ask ourselves what we mean by the evolution of a material 
system, I think you will agree with me, upon reflection, that we mean 
its history, the succession of past and future states through which it 
passes. We further have in mind that particular type or kind of his- 
tory which bears a distinctive stamp of a forward direction in time, 
as distinguished from a strictly periodic sequence which repeats the 
same cycle over and over, or a purely changeful sequence in which no 
characteristic difference between forward and backward direction 
in time is discernible. Just what fundamentally distinguishes the for- 
ward direction in time we shall not on this occasion seek to discuss 
nor, indeed, can there be any question here of discussing in its entire 
generality the evolution defined as above. We are interested for the 
moment in a particular kind of system, and in certain particular as- 
pects of the evolution of a system of this kind. 

The aspect of evolution with which we are here concerned is 

* Address delivered before the Symposium on Mathematical Biology held dur- 
ing the meeting of the A.A.A.S. in Chicago, December 26-27, 1947. 


Other papers presented at the Symposium are also being published in The 
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ook Rapoport, Anatol and Shimbel, Alfonso. 9, 169, 1947; Culbertson, J. T. 10, 
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that which views the system under consideration as built up of cer- 
tain components, and which contemplates the distribution and the 
changes in the distribution of the substance of the system among 
these components. 

The particular aspect of the problem regarding such systems 
which we choose to study evidently depends on the manner in which 
the components are defined or described. We may be concerned with 
the course of events in a system composed of stated chemical elements 
or compounds, or phases of such, which are capable of physicochemi- 
cal interaction. We may then ask what changes will take place in 
the composition so defined, of the system, and, in particular, we may 
ask, do these changes tend in some particular direction or toward 
some particular ultimate state? We may also ask, how is the direc- 
tion of these changes and the end state characterized? As you know, 
the course of such physicochemical evolution is such that under cer- 
tain conditions a function of the system as a whole, its thermody- 
namic potential, tends toward a minimum, 

But we who are meeting here today, a sort of crossbreed between 
physicists and biologists, have a special interest in the evolution of 
a system somewhat differently defined. The system before our mind’s 
eye is not contained in a test tube or flask in the laboratory. It is 
spread as a relatively thin film—the biosphere—over or near the sur- 
face of our globe. Its components, as regarded from our point of 
view, are biological species, themselves subdivided into individual or- 
ganisms. 

What interests us here is the distribution, and changes in dis- 
tribution, of the total substance of this system among its several com- 
ponent species; and, in further detail, the changes in the frequency 
distribution, within each species, of varieties of individuals comprised 
therein. A mental construct, a geometric representation, is perhaps 
helpful here in vividly portraying the nature of the processes to our 
mind. If we imagine the character of each individual organism as rep- 
resented by a point in n-dimensional space, corresponding to the val- 
ues of n characteristics in terms of which the organism is defined or 
described, then we would see the state of the entire system at any 
particular moment represented by a number of separate clusters or 
clouds of points, each cloud corresponding to one species. Each such 
cloud would exhibit a varying density of points within its boundary. 
With the passage of time we should observe two kinds of changes. 
The masses of the several clouds would change—in accordance with 
the process of inter-species evolution; and, within each cloud, the dis- 
tribution of point densities would change. Changes of this latter kind, 
intra-species changes would, in general, affect the boundaries of the 
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individual clouds; so much go, in some cases, that after a sufficient 
lapse of time the new position of the cloud would lie entirely outside 
of its original position, thereby representing what would be regarded 
as a new species. 

Changes of the second kind—intra-species evolution—obviously 
have a certain special interest and there has been a tendency to con- 
centrate on this aspect of evolution. On the present occasion, I pro- 
pose to concentrate our attention rather on the first kind of changes, 
the inter-species evolution of the system, that is, the changes in the 
distribution of the matter of the system among the several component 
species. These changes are often relatively rapid, so that in contem- 
plating them we may in first approximation often disregard the slow 
changes of intra-species evolution. 

In approaching the problem of the physics of organic evolution, 
we have the advantage of being able to profit from our experience 
with the somewhat simpler and more completely worked out problem 
of physicochemical evolution. Let us consider some of the points of 
similarity and some of the points of difference between the two prob- 
‘lems. 

That they are of the same general type follows directly from the 
way in which we have defined evolution—as a change in the distribu- 
tion of matter. But to one point of similarity I wish to draw particular 
attention. The evolution considered in each case is the evolution of 
the system as a whole. In the reaction 


2H, + 0, = 2H20 


we are not discussing the history of the hydrogen in the system, or 
of the oxygen, but the history cf the system as a whole. In seeking 
the fundamental principles of organic evolution we may be assured 
that we shall make adequate progress only by considering a system 
of coexisting organisms and their environment as a whole. For ex- 
ample, it is fruitless to ask whether the trend of evolution is toward 
low mortality accompanied by low fertility or, on the contrary, toward 
high fertility counterbalancing high mortality. The fact is that or- 
ganisms of both these extreme types have been evolved, forming in 
many cases a system of interdependent prey and predator species. If 
we seek a basic law of evolution, we may be assured that it will be 
formulated in terms of a system of interdependent species and their 
environment as a whole. 

But while we shall no doubt be well advised to give an important 
place in our thoughts to these points of similarity, there are certain 
points of difference of equal importance. | 

1. In the discussion of physicochemical systems, chemical com- 
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position plays a dominant role, and structural features at most play 
only a secondary role—often no explicit role at all. 

In the case of the system of organic nature, this situation is re- 
versed. A sheep may not differ very greatly in chemical composition 
from a lion; what sets the two apart and determines their relative 
roles in the scheme of nature is their widely different structure and 
corresponding behavior pattern. 

Whereas the possible physicochemical transformations in a given 
system are limited, possible changes in structure are, in principle, 
unlimited. In accordance with this, the evolution of a physicochemi- 
cal system under stated conditions is commonly a process which termi- 
nates.* Organic evolution, on the other hand, because of the infinite 
possibilities of changing structure, is apparently a continuing process 
without an end under given conditions. 

2. Much of the theoretical discussion of physicochemical evo- 
lution relates to systems proceeding toward an equilibrium in which 
the system is self contained, in the sense that it receives no energy 
from outside. 

Organic evolution on the earth, on the other hand, is typically a 
process taking place under a continuous stream of energy from an 
outside source, the sun.t Wherever our investigation of the physics 
of organic evolution may lead us, of this we can be sure— no treat- 
ment of the problem which fails to give a prominent place to this 
feature can really strike at the root of the matter. Our fundamental 
purpose must be not merely to formulate the law of organic evolu- 
tion as an empirical fact—whether in terms of “increasing organiza- 
tion” as some have proposed, or in any other terms—but to deduce 
this law, whatever its form, as a necessary consequence of funda- 
mental physical principles. 

Certainly, the discovery of empirical relations is not without in- 
terest, but it must be kept in mind that such relations pose a problem 
rather than solve one. When we observe an empirical law we ask, 
why this law, if such it be? 

3. <A third distinctive characteristic of organic evolution as 
against physicochemical evolution is this: 

In the study of physicochemical systems, the bulk properties of 
the components are readily accessible to observation and form the 
first point of attack. The investigation of the properties of the finer 
units, molecules, atoms, etc., on the contrary, requires special highly 
refined methods. 

, *Theoretically this may require an infinite time, but in practice the end state 
is commonly attained within close limits in a finite time. 
{In this respect it resembles photochemical reactions. 
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In studying the system of nature in the course of organic evolu- 
tion, this situation is essentially reversed. The individual units, the 
individual organisms, being in many cases of dimensions comparable 
with our own, are commonly quite easily accessible to direct obser- 
vation. It is rather the collective or bulk properties of populations 
of organisms that more severely tax our resources for investigation 
by field studies, statistical methods, etc. 

Since there are these two avenues of approach available in the 
study of an evolving organic system, we may profitably proceed along 
both. It is to be noted, however, that the second method, based on 
the observation of bulk phenomena, tends in the first instance to lead 
to empirical generalizations, the inner significance of which is often 
not apparent, but needs to be peeled out from the empirical context 
by a separate investigation. The fact is that these bulk or collective 
phenomena are not really and fully understood until their relation to 
the properties of the individual organisms and the environment in 
which they play their part is clearly laid bare. In this respect the 
first method, which proceeds outward from a study of the individual 
organisms to a comprehension of their collective effects, promises to 
be the more efficient, the more directly productive of fundamental 
results. 

With these significant points of similarity, but also no less im- 
portant points of distinction between the two cases of evolution— 
physicochemical and organic—we may indeed draw profit from the 
experience gained in the study of the first case, but on the condition 
that we proceed guardedly. That this caution is necessary is evident 
from instances on record of undue significance attached to surface 
analogies. For example, the principle of Le Chatelier has been stated 
in the form: “Every external action produces in a body or system a 
change in such direction, that in consequence of this change the re- 
sistance of the body or the system against the external action is in- 
creased.” (Chwolson, 1905, p. 475.) 

Even as applied to a chemical transformation the statement in 
this form can be misleading, since it does not clearly indicate what is 
meant by “resistance.” The fallacy arises from the fact that this form 
of statement fails to distinguish between the intensity and the ca- 
pacity factor of the energy involved. 

Still less is the principle in such vague form capable of useful 
application to systems composed of or comprising living organisms, 
as has been repeatedly suggested (Chwolson, 1905, p. 476; Bancroft, 
1911, p. 92) without even indicating what particular parameters are 
referred to by such terms as “external action,” “direction,” “‘resist- 


ance.” 
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Again, V. Volterra (1937) * in his mathematical analysis of the 
interaction of coexisting organic species introduces such concepts as 
action vitale élémentaire, travail virtuel d’ accroissement, énergie de- 
mographique actuelle et potentielle, etc., which are so termed quite 
frankly by analogy to certain quantities or entities rigorously defined 
in physics.} The impression is thus given that Volterra’s analysis is an 
application of rigorous physical principles to biology. Actually, of “‘en- 
ergy” or “action,” in the strict sense in which the physicist uses these 
terms, there is no mention or even definite implication in Volterra’s 
analysis. There is danger that by hastily giving to certain mathemati- 
eal constructs the names of established physical entities, we desist 
from further efforts to fathom the truly physical relations involved.t 

If now we turn from verbal imitations of physical concepts to 
view our problem of organic evolution in its truly physical aspects, 
what is the general outlook that presents itself to us? 

We contemplate an aggregation of energy transformers of dis- 
tinctive structure and function, the living organisms. A character- 
istic of such an organism is that it maintains its state of being by the 
expenditure of certain quantities of substance and energy, which its 
distinctive structure enables it to recoup from external sources. 

These sources are, broadly classified, of two kinds: The first kind 
are distributed in space in essentially continuous fashion—matter in 
the form of gases (CO. , N.), and substances dissolved or capable of 
being somewhat readily dissolved; and energy, in the form of radiant 
energy pouring down upon the earth from the sun. 

The second kind of sources are distributed in essentially discon- 
tinuous fashion, matter and energy of plants and animals upon which 
the organism feeds, thus deriving at one time both substance and 
energy needed for its maintenance and growth. 


*He himself puts it this way: “On peut appeller action vitale élémentaire 
(une certaine expression analytiaque) en voulant adopter une locution analogue 
a celle qu’on emploie en mécanique.” 


_ ‘Actually these physical prototypes and their analogues in Volterra’s analy- 
sis are of totally different dimensions, a fact which he passes over in silence. 

{This reflection should make it evident that I am not here offering a mere 
verbal quibble. A quotation is apposite. In a paper, The Place of Geophysics in 
a Department of Geology M. King Hubbert (1938) remarks: “A common error 
arises when the workers in one field, impressed by the successes of workers in an- 
other have set about to find an analogy between the phenomena of the two fields, 
so that analogous relations could be established; or, as sometimes happens, when 
the successful worker in a certain field attempts to solve the problems in another 
by an incorrect analogy.” 

One of the most extensively “borrowed” physical terms is that of “potential.” 
As Volterra (1987) speaks of potentiel démographique, so L. Hersch (1940) of 
a potentiel-vie; P. Vincent (1945) of potentiel d’accroissement; J. Q. Stewart 
(1947) of “potential of population”; L. C. Birch (1945) of a biotic potential. 

None of the quantities referred to in these terms is of the dimensions of a 
physical potential, that is, energy in the strict physical sense. 
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Corresponding to these two types of sources of matter and energy 
are two broad classes of organisms: Green plants, characteristically, 
though not universaily, sessile, since they can sit and wait for food to 
come to them. And animals, characteristically, though not universally, 
mobile, since for the most part they have to go foraging for their 
sustenance. Because of this mobility, and the “ingenious”* mechanism 
with which they are provided for carrying on their life—sustaining 
activities, these organisms, the more highly developed animals in 
particular, present features of the greatest interest, and I propose in 
what follows to concentrate our reflections on this type. 

In seeking to approach a problem by the methods which modern 
science has developed with such success, it may not be amiss to make 
some observations in passing regarding one of the characteristics of 
the scientific method, to which undoubtedly much of its success is to 
be credited. The history of science itself gives us a clue. Among the 
earliest branches of science to be developed with very creditable re- 
sults was astronomy. This science profited by the advantage that its 
data came in about the simplest possible form: mathematical points.t 
Without further elaboration of its raw material the science could 
proceed to observation and to systematization of its findings. 

As an example at the opposite extreme one might perhaps cite 
chemistry, one of the latest sciences to be developed. It could not 
progress to any significant stage until out of the hodgepodge of mat- 
ter in nature, elements and compounds had obtained separate recog- 
nition and understanding. 

The science of physics may be said to have occupied, historically, 
a position between these two extremes. The physicist has his own way 
of securing that relative simplicity of basic data which is necessary 
for the fundamental attack on scientific problems: He can mold his 
material to size and shape—a cube of given side, a wire of given gauge 
and length, etc. 

He has also another expedient which has proved of inestimable 
value as a tool for the discovery of fundamental principles, a method 
which in a language just now somewhat unpopular, but rather well 
adapted for coining words, has been termed the Gedankenexperiment. 
I well recall how, in my verdant undergraduate days, I was half 
amused at the “naive” engine by the aid of which Carnot’s cycle 
and thence the second law of thermodynamics was developed on the 
blackboard, if you please. Here was an engine consisting of a cylin- 
der with perfectly insulating sides and a perfectly conducting bot- 

*T hove tried unsuccessfully to find a word without anthropomorphic flavor 
to describe the quality in question. 


+To the naked eye and the simple instruments of early astronomers planets 
as well as stars were practically points. 
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tom. A source with similarly fantastic qualities completed the instal- 
lation. No such engine ever existed except on the blackboard, none 
such in “real life.” I took occasion after the lecture to remark to 
Poynting about it. “Yes,” he replied, “but you will see what far- 
reaching consequences follow.” 

With these lessons from the history of science before us, what 
shall we do with our problem of the dynamics of an aggregate of in- 
teracting energy transformers possessed of the characteristics of liv- 
ing organisms? 

We cannot make our organisms over to measure and scale. But 
in imagination we can mold them at pleasure as to their fundamental 
physical characteristics. I suggest that we try the method of abstrac- 
tion which has been so fruitful elsewhere. If some of our premises 
appear “naive,” and perhaps tempt a smile to some lips, let us not 
be discouraged at the start. 

We begin on familiar ground. To get down to essentials we dis- 
sect the organism—not in the laboratory with scalpel and forceps, but 
with our analytical faculties. In the working of the animal energy 
transformer we distinguish certain fundamental parts or elements. 

(a) Receptors, which depict features of the environment in the 
organism. The typical example is the eye; but more generally, sense 
organs fulfil this function. Their efficiency is, in principle, suscep- 
tible of numerical measure, as for instance visual acuity, or range 
of visibility for an object of given size. — 

(bo) Elaborators, which derive from the raw material supplied 
by the receptors, secondary information supplementing the picture 
of the environment as depicted by the receptors. These elaborators 
are developed to an outstanding degree in man, where they include the 
“logical” faculties. I have at the moment no suggestion to make for 
the numerical treatment of the elaborators. Except in man they 
play a subordinate role and may perhaps in first approximation be 
left out of account. 

(c) EHffectors, by which the organism reacts upon the environ- 
ment, whether it be by its own locomotion to change its position rela- 
tive ‘S features in the environment, or by modifying the environment 
itself. 

The effectors operate with an expenditure of free energy released 
by trigger action, a fund of such free energy being present as a 
characteristic endowment of every living organism. One of the func- 
tions of the effectors is to gather or capture free energy and material 
substance from available sources, to recoup that expended or “lost” 
in their activity. Losses of entire organisms must be made good by 
the growth (birth, etc.) of new organisms, which is provided for in 
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the normal cycle of existence of the organism. 

Another function of the effectors is to perform acts of defense 
against or escape from situations harmful or fatal to the continuous 
existence of the living organism. Failure to escape, which for many 
species is an unavoidable risk, constitutes one of the sources of the 
losses referred to in the preceding paragraph. 

Escape from hazard commonly takes place by flight to a refuge, 
such refuges* being scattered over the topography in which the or- 
ganism operates (Lotka, 1928, 1932; Elton, 1939). 

A numerical measure of the efficiency of the effectors will in 
many cases suggest itself, such as for example the maximum velocity 
in pursuit or escape; the relative “strength” available, as measured 
in first approximations by size;+ the passive resistance to crushing 
(as in the shell of a tortoise) ; etc. (Elton, 1927.) 


As to the energy relations involved in the operation of the effec- 
tors, account must be taken, not only of the energy expended in the 
essential activities (pursuit, flight, etc.), but also in what might be 
termed incidentals. These would include seemingly aimless “random 
migration” and play activities, as well as the physiological work that 
continues quite aside from any outward activity. In a sense the or- 
ganism may be likened to an automobile whose motor cannot be 
stopped, so that it goes on “idling’’ even when the car is standing still. 

(d) Adjustors, which determine what action the effectors shall 
perform, in accordance with the information (picture of the environ- 
ment) supplied by the receptor, as supplemented by the elaborators. 

The quantitative treatment of the adjustors requires a special 
approach; for, their function is to determine the choice between vari- 
ous forms of energy expenditure by the organism, among the several 
opportunities open to it. If the organism can operate to modify vari- 
ous parameters Q,, Q,2, ---- , by increments 0Q,, 0Q., ---- , and if 
each such increment separately brings with it an increase dr in the 
rate of increase r per head (or per unit of mass) of the species then, 
from the point of view of purely material advantage to the species, 
the ideal adjustment would be that which would make r a maximum. 


*A refuge is any part of the topography rendering the prey organism inac- 
cessible to the predator; for birds, for example, the air or the branches of a tree, 
or a sheet of water in the case of aquatic species, present a refuge against most 
ground living animals. 

+In this connection an interesting point to note is the observation that a food 
chain (each member functioning as prey to the preceding). usually does not great- , 
ly exceed five links. . 

+The case of the human species, in this as in other respects, brings up special 
problems. We do not look upon mere multiplication of our species as a desidera- - 
tum. The problem of optimum population, which arises here, will not. form. part 
of the present discussion. , S 
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From this ideal adjustment the several species will deviate in vary- 
ing degree. ids 
In the case of man, when the choice is made consciously, it is 
experienced as a judgment of the value of the different actions or of 
the things secured by these actions. Thus the economist’s value in 
exchange (commonly measured in money) is seen to be related to an 


or ; 
entity of the dimensions of 50” and we have here another instance of 


loose application of an analogy when certain writers* speak of eco- 
nomic energy, of which value is to be the intensity factor. 

The physical characteristic of the adjustors is that they guide, 
through trigger action, the release into suitable channels of portions 
of the free energy at the disposal of a living organism. It is the ac- 
tion of the adjustors—whether in elementary form through reflex ac- 
tion, or in the form of voluntary action as developed to its highest 
degree in man—that imparts especially to the higher forms of organ- 
isms the quality of Maxwell Demons on a molar scale. 

Here we run into the phenomenon of will, which seems to be quite 
foreign to and outside the scope of contemporary physics. Certainly 
we shall not expect to find any reference to it in any of the current 
textbook of physics. Nevertheless, this phenomenon of will does have 
a certain definite physical context. Willed actions are possible only 
to structures disposing of a fund of free energy—structures which in 
that sense are in a metastable state. One cannot will a past event, will 
necessarily involves the future, just as the metastable state contains 
the seed of the future. We are not, then, wholly without a connecting 
link between physics and the phenomenon of will. A big question 
mark, of course, remains as to the significance and the role of con- 
sciousness in the operation of the organism,f£ but we shall not wait 
to see all questions resolved before proceeding in our reflections and 
investigations of the physical aspects of life and of the evolution of 
living organisms. 

Having thus dissected the organism (more especially the animal 


*Notably G. Helm, (1887). 


yIt should hardly be necessary to point out once again that this does not in- 
volve any infringement of the second law of thermodynamics, since we are not 
dealing with an isolated system, but with one that is currently receiving a stream 
of free energy from the sun. 


tI have elsewhere suggested that perhaps the intervention of consciousness 
for the performance of many tasks that can also be performed by non-living mech- 
anisms may be nature’s way of achieving an economy of parts. Certainly, to 
perform the well nigh infinite variety of tasks of which for example a human in- 
dividual is capable, would require, at best, a gigantic installation. So we have 
become accustomed lately to calculating machinery that fills an entire room of con- 
siderable dimensions. Compare this with the compactness of the human brain. 
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type) down to fundamentals, that is, to those qualities and functions 
not peculiar to one particular organism or species, but characteristic 
of and possessed by a large and representative group of organisms— 
Wwe are now prepared to proceed with our Gedankenexperiment. 

You may, if you like, regard this as just a game. But let me re- 
mind you that the theory of probability, with all its modern highly 
technical applications, arose on the foundation of seemingly frivolous 
inquiries regarding games of chance. 

Our game, then, will be of the type which, like chess, is played 
upon a “board,” that is, a topographical map. 

Since we are dealing with an abstraction we have considerable 
freedom in designing this map, so long as it conforms to the type of 
our problem—that is to say, it will contain scattered refuges. To start 
with something simple, we may suppose the refuges arranged accord- 
ing to some geometrical pattern, say hexagonally. Over this topog- 
raphy we may suppose, again for simplicity as a starting point, two 
species operating, a predator species and its prey. To each we can 
assign specific receptors, effectors and adjustors, choosing again, for 
a beginning, very simple specifications. The prey species, we may 
suppose, subsists upon some food present in abundance, so that its 
supply may for purposes of the example be regarded as essentially 
constant. 

With this setting (to which we may perhaps find it necessary 
to add further data) we may investigate the conditions for capture, 
the frequency of capture, and the consequences for prey and predator 
species, both of the conditions as first assumed, and of any modifica- 
tions in these conditions which we may further contemplate. 

As I have elsewhere given indications of the kind of approach 
that may be made to this problem, I need not here repeat these sug- 
gestions. But this I should like to say: On the most conservative esti- 
mate, suppose we are merely playing a game. When we think of all 
the time and mental application that has been and will continue to be 
spent on playing chess, bridge, checkers and the iike—to say nothing 
of books, some of them most profound, that have been written on these 
games and on the theory of games generally*—when we think of all 
the efforts thus spent, will not our game at least have the merit of 
being related to profound problems of real life, as against the relative 
trivialities of parlor diversions? 

If our most modest expectations should be exceeded, if our 
Gedankenexperiment should yield even only a fraction of the results 
that have sprung from Carnot’s ideal heat engine, we should be well 


*Outstandine in this field is the recent brilliant work of von Neumann and 
Morgenstern (1944). 
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served. 

Perhaps one result which we might expect is a rigorous con- 
firmation of a maximum law, which I have elsewhere suggested as the 
law of organic evolution. If I may, somewhat inadequately, sum- 
marize in one sentence what I have expounded more at length else- 
where, (Lotka, 1945) it would be to this effect: 

All in all, those species have the advantage which know best how 
to tap and put to favorable use the stream of energy available in 
nature. Collectively, this will tend to increase the flux of energy 
through the system of organic nature, which flux may thus be said 
to be approaching a maximum. 

The function of the adjustors in “putting to favorable use” the 
energy captured has today risen to superlative importance, beyond 
all previous conception, by the tapping of that new and unparalleled 
source, nuclear energy. 

In point of control over immense powers this new development 
has placed man, out of all proportion, above other living species. 
Whether he will profit by the new opportunity, and thus continue the 
process of increasing the energy flux through the system of organic 
nature, or whether his species will prove unfit by turning the new 
power against itself, this will be the supreme test of the adequacy of 
his adjustor faculties. If he fails in the test, evolution may have to 
make a fresh start from a lower level, either with some of the less 
advanced sections of the human race that may be saved from the 
holocaust, or with some other “inferior” species. Should this occur, 
it will be another example of a phenomenon not unfamiliar in paleon- 
tology, a species that has become the victim of overspecialization. 

* * * 

In addressing you here today I have admittedly presented to you 
a program rather than a report of results. For this I believe I need 
make no apology, since one of the main purposes of these meetings 
is to afford opportunity for interchange of ideas, and to stimulate 
thought. 

In this I trust I have not altogether failed. 
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It is shown that the instantaneous concentration of an indicator at 
one point in a circulation can be related to all previous concentrations at 
a second point by an integral equation. Solutions of this equation give 
formulae for the computation of the mean transit time, the flow, and the 
volume of the circulation between the two points. 


Cardiac output has been estimated by injecting a salt or a dye 
into a vein and measuring its concentration in an artery (Stewart, 
1897; Hamilton and Remington, 1947.) This paper presents a theory 
for the interpretation of such measurements. 

It is useful to think of the movement of blood from the left heart 
as resembling a river which separates into several branches that flow 
into a like number of swamps, the systemic capillaries. Their drain- 
age forms a single stream which again divides and runs through a 
second set of swamps, the pulmonary capillaries. However, the flow 
through the swamps differs from the sanguinous circulation—drain- 
age from the second swamps is to the ocean, but from the pulmonary 
capillaries drainage is again to the left heart. 

Suppose at the moment t = 0 we suddenly add to the inflow of 
the swamps an amount M of an indicator I, which stays in the 
stream. If f(t) is the probability that it takes a particle the interval 
of time t to traverse the swamps, then the fraction of M flowing out 
of the swamps at time t will be f(t) and hence the rate of drainage 


dM 
of J from the swamps will be Bert == Mf (t)0r 


dM = Mf (t)dt. (1) 
If F is the flow through the swamps per unit time, the drainage 
from the swamps in the time dt is Fdt.. Hence the cross-stream aver- 
age concentration C of I is ; 

dM Mf (t) 
Cc!) == = — 

Fdt F 
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(2) 
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Equation (2) can be generalized so as to relate the concentration 
of I in the drainage, C,, to the concentration in the inflow, Ci. The 
fraction of C.(t) contributed by the inflow at time, t—7, is 


dC, (t) = Ci (tn) f(y) dy . (3) 


Integration over all previous time gives 
Ca(t) = | C.(t—) fn) dy. (4) 
0 


Equation (2) does not apply to circulations because it does not ac- 
count for indicator fed back into the inflow from the drainage, e.g., 
indicator passing through the system for a second or third time. The 
quantity C, in equation (4) includes all J. Hence equation (4) should 
be used in calculating the behavior of a circulation. 

It is easy to solve equation (4) when J is added to a circulation 
at a constant rate m. Conceive circulation from X to Y , from Y to 
Z,and from Z to X. Then Y, the point of addition, is “between” X 
and Z. The quantity C, at X is related to C. at Z by 


mé(t) 
F 
where 6(¢), an arbitrary function accounting for transients, increases 
monotonically, 0 S$ 6(t) $1. 
The average concentration of indicator throughout the circula- 
tion at time t is mt/V, where V is the volume of the circulation. Since 
for capillary beds f(t) is not a delta function* or a sum of delta 


functions, transients are damped and C at any point approaches 
m(t—a) /V, where a depends on the point of addition. 


Ast o, 
mM m (t—a—n) 
ct Be [MOD pena (6) 


C(t) = + f Captian, (5) 


or 
C,(t) =m/F + C,(t) —mb/V, (7) 


*A “delta” function is an impulse function which is defined in the following 
way: 
(t-to)? 


é 2a? 


8(t—t,) = lim —— 
a>0 V2 a 


i 8(t—t,)dt=1. 
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where b is the average time of transit from X to Z. If the point of 
injection is “between” Z and X , 


C.(t) =C,(t) — mb/V. (8) 


Equations (7) and (8) give the flow through and the volume of 
any part of a circulation. Thus, let J be injected into the right heart 
at the rate m. The concentration in the aorta is 


Ca, = Cy, — mb/V + m/F, (9) 


where F is the cardiac output, b is the mean transit time from the 
right heart to the aorta, V is the blood volume, and C, is the concen- 
tration of J in the superior and inferior venae cavae. 

Let I be injected into an arm or leg vein; then 


Cu, =Co,—mb/V. (10) 


Equations (9) and (10) determine b and F for known V, which 
can be easily found from the final dilution of a known amount of a 
blood volume dye. The volume of the pulmonary circulation is 


é Vo= Fb (11) 


Our interpretation of F will depend on our anatomical knowl- 
edge. Thus, if C, is for the internal carotid artery and C, is for the 
internal jugular vein, F is the flow through the internal carotid plus 
other inflow to the circle of Willis. 

‘Since injection at a constant rate may not be experimentally fea- 
sible, more general methods of computation are necessary. These 
methods depend upon determining f(t), which may be found from 
equation (4). 

If for t < 0, C,(t) = 0, equation (4) becomes 


C2(t) = i) C,(t—n) f (q) dn - (12) 
Differentiation gives 
Cu! (t) =C,(0) f(t) + { Cy’ (t—n) f (n) dn. (13) 


Solving for f(t), we have 


Cu 1 sae SH 
— ee C,' (t= d (14) 
KO=oe sata (ty) fn) dn. : 


Successive substitution of the expression for f(t) given by the 
right-hand side of equation (14) in f(y); w which occurs on the right- 
hand side, leads to a formal solution, namely, the series: 
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t 


C,' (t) 1 , 
=— = C,’ Foes 1) Cz ( 1) 1 
f(t) C.(0) cin (t—y Ni) &y 


tl C:(0) ah ap os (om) fo Cy’ (1 — Nhe (15) 


m=2 


)m-1 
Cy (%4ma— nw) C,’ (ym) dym oie sie dn, 5 


0 


This series converges for all finite values of t, because |C,'(t)| = P 
and |C,'(t)| S Q, where P and Q are positive numbers. Hence, 


-@ Pt (SVs. 16) 
i) cs(G) ae eat LO) pie 


or 
Pt 


5 Win Cx(0) 
f(@) Ss C, (0) ese : 


Ast > ow, a sufficient condition for convergence is that |C,'(t)| = 
Q and that 


[icr@| dt = C,(0). 


If C,(0) = 0, equation (15) has no meaning. In that case, dif- 
ferentiation of equation (13) gives 


C." (t) =C,'(0) f(t) + { Cs" (t—n) f(g) ds (17) 


If |C,'(0)| > 0, this equation can be solved for f(t) as above. The 
proof of convergence is similar. 

A more elegant method of solution of equation (14) is by Laplace 
transforms (Churchill, 1944). It can be written as the general in- 
tegral equation of the convolution type, 


t 
Y(t) =F(t) + [ G(t—4)¥n)dn, (18) 
whose transform is 
y(s) =f(s) + g(s)y(s) (19) 
or, 
y (8) eee Ea (20) 
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The inverse of equation (20) gives Y(t), which corresponds to 
f(t) of equation (14), as an explicit function. 

Thus we obtain formulae for the computation of f(t) which are 
independent of the method of injection, although concentrations fol- 
lowing instantaneous injection should give a most rapidly convergent 
solution. 

Once we know f(t), we can easily correct concentration curves 
for recurrent indicator and find the mean transit time, flow, and vol- 
ume for a part of the circulation. The only limitations of the method 
are the accuracy with which measurements of instantaneous concen- 
tration can be carried out and the degree to which circulation is al- 
tered as a result of experimental manipulation. 
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We discuss under the McCulloch and Pitts assumptions for neural 
nets a circuit consisting of k cycles such thet one cycle is activated by 
an outside stimulus and sends an impulse to a second cycle which in its 
turn sends an impulse to the next cycle, etc., up to the kth cycle, which 
sends an impulse to a response. We thus have a “series” of k cycles 
“interacting.” We give several theorems regarding the response patterns 
of such circuits under the additional constraint that the stimulus acts 
but once, and at the time it acts the circuit is at rest. 


The circuits discussed here are of the McCulloch and Pitts 
(1943) microscopic type. The general representation of the kind we 
will consider is shown in Figure 1. It has k cycles which have 


i ene we ak 


D 


| 


FIGURE 1 


N,, +++, NM synapses respectively. We define the class of all response 
times of R to be R,. We consider the members of ‘Rx as pure num- 
bers. In addition, we allow S to act but once and specify this action 
time to be r, = — (k + 2), where k is again the number of cycles. 
With this value of +, we are always assured of having zero as the 
smallest member of R; . 

For k = 1 we have for ®;: 


Ri ={0,%,2n,,---+} 
={im)};  G=0,1,2,+-). 
Taking k = 2 
123 
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Ro =" (OS Ns ole 
Ng» Ny +My, 2M TF Nes =F 
2. , Ny + 2Ne , ZN, + 2Ny, -*>- 


== {1,, + tilts} ; (2-0 ,1G2s---o)e 


Continuing in this manner, we obtain the expression for ‘R; in terms 
of the numbers of synapses in the cycles. 


Re = {ty + vee + eM} 5 (4;=0,1,2,----). (1) 


In other words, R; consists of all integers that are sums of non-nega- 
tive multiples of the numbers 7,, ---: , %. Our problem is to find 
out what integers are included in R; for an arbitrary set 7, ---- , % 
of numbers. 


Theorem I. Given that: 
Lit Re fy beset } pe 0, ee, 22s 
2s. BU Nie) ee ten 
(EN) (1) (NeR,-4 2 0 > N + teRx). (2) 


This theorem states that if the GCD of n,, --:- , m is one, then there 
exists an integer N in ®;, such that every integer greater than N is 
also in ‘R;. 

Proof: We know from number theory that if the GCD of k num- 


bers 7, ---- , m is unity, then there exists a linear combination of 
these / numbers such that 


(ble Cre Se as OE (3) 


Separating equation (3) into a positive part and a negative part we 
have 


(da, Me, + +++ + da, Na) 
(4) 
et (ag Ng +.... + Cpe me, 1) — 1. 
If we designate 
Br-1 
P= So) Nas Q=Lag ng, (5) 
j=a1 J=B1 J J 


we can write equation (4) as follows: 


ee (6) 
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which tells us that (P,Q) =1. 

Denoting a complete set of residues of Q by C,,----, Co; we can 
form the products C,P, ---- , CoP, which again give a complete set of 
residues of Q. From equation (5) we can see that PeR; and QeR, 
(taking respectively in the expression for R;, the values ip. ae tp 0, 
ta, = da, and ip, — Og, ta, A ee 0). In the expression for R,, 
the 2’s range over all non-negative integers so that the multiples C,,P 
are also in Re (ig = ag = 0, ta, = CmOa, ) . This gives a complete set 
of residues modulo Q(C,P,----, CoP) all of whose members are in R; . 
Now by allowing vp. = tg. pet? 91.2 ee) | we. Can add: all non- 


negative multiples of Q to this set of residues, thereby building up 
all the integers that are greater than a certain integer N (in this case 
N = (P— Q) (Q— P)) as members of R; . This completes the proof. 

In the following we will use the term ‘“N-value” for any integer 
in ‘R; that is greater than or equal to an N satisfying Theorem I. 
When (”,,--::, %) =d 2 1 we have the following 


Corollary I. Given that: 
ER — ht eet ot 1g (0p OS 12s, 2) 9 
a he a, Se 
3. Ry=Df N'((n, y+. m) =d-N' eR, SN’ +deR,), 
then 
meR,=M=N + idiz0.NeRx. 
Proof: Factoring expression (1) of the hypothesis we have 
R, = din +--+. + iy}. (7) 


The expression in brackets by Theorem I contains all integers greater 
than at least one integer N,. Multiply N, and all greater integers 
by d and obtain dN,, dN, '+ d,---- and no others. With N = dN, 
we see they are all of the form N + id, which proves the theorem. 


Theorem II. Given: 
Le Res {iy Hie - UM), 
2. (M1 0+, Mm) =a, 
Sola Risso 1s 
then 
1. — (Ea, 6) (ae Rx Be Ri. la—p| <d.a#§), 
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2, —(Fa, 8) (a6 Ripe Rie |G f ots 


where a, f are consecutive. 

Conclusion (2) is obvious from the definition of R; and condition 
(3) of the theorem. To prove conclusion (1) assume that there are 
two distinct numbers a and f such that |a — | < d. 


Designate them by 
O=AnN, +--+ + AGN, 
p — Oy oe Opi 
so that 
ja — B| =| ayn, + +--+ + OM, — (DN, + +++ + DM) | 
= d|n,' (a, — by) +.--++ + 2x (te — dx) | . 


From this we see that — [|a — | < d] unless a; = b; which contra- 
dicts the hypothesis that a and f are different. 


Corollary I. Given two circuits of type shown in Figure 1 such 
that circuit I has an N-value of N; and cycles of 7,,--:: , m and cir- 
cuit II has an N-value of N,, and cycles of m,, --:+ , m,, then if 
n; = dm; for all pairs of consecutive pairs a, , 6, > N;and a, po > Nu 
appearing in the response patterns of the circuits I and II, we have 
ja: — B;| = dja, — §,| . 

In other words the gaps in the case of circuit I are d times as 
great as those for II. 


Proof: From Theorem II we have 
| Oty cal = d,|n,' (a, = b,) OU = Nx. (dy, — bx) | 
|o2 — B2| = dd,|m,' (a, — b;) +-+++ + my’ (G, = dy) |. 


Corollary II. Two circuits I and II similar to ones considered in 
Corollary I such that (”,, +--+, Mm) = (m,,-+++, m,) are identical in 
their response patterns after some finite N-value is reached. 


Theorem III. Given that: 
1 R,= {4n, + 1gNo} , 
2. (n, »N2) =1 ’ 


3. R= Df N'(i) (Ne R,piZ0>N' + ieR), 
then (a) (ae R,. Ne R..NSa7>N= (mn; — 1) ( nm. — 1). This theo- 
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rem gives the smallest integer for which Theorem I is true when 
oo 

Proof: In &; let 7, run through the smallest positive complete set 
of residues modulo n.(0, 1, ---- , m. — 1). Then a complete set of 
residues mod nz is in R, (where 7, = 0). Now by varying i, we can 
get a complete set consecutive in R, whose last member is (n. — 1) 
(n,). The first member of this set will be (n. — 1) (11) — (™% —1) = 
(m% — 1)(m, — 1). This is the smallest such N. We could inter- 
change the subscripts 1 and 2 throughout and obtain the same result, 
because 7, and n, are symmetric in (n, — 1) (nm, — 1). 


Corollary I. Given: 
1. Re= {in, + En}, 
2. (m%,%) =d, 
then the N of the theorem is given by 


Proof: Let n. = dn,', n, = dn,’ where (n,', n.’) = 1. The smallest N 

for ny’, np’ is (m,' — 1) (m-' — 1). As Re = d{i,.n,' + %n,'} then the 
nN N. 

smallest N for Rz is d(n,’ —1) (n.’ — 1) = Bee 1) (2-1) : 

In the proof of Theorem I we allowed all of the 7; to run through 
all positive integers. Actually, this is not necessary as it gives numer- 
ous duplications. We can restrict all of the i;’s except one to finite 
ranges by the following. 


Assuming again that (m,,----, m) =d, we obtain, 


=n 
(8) 
Ny, = an; 
So from this we see that 
k n k 
* in! =.= Hn, (9) 
Ny tn NK 1=1 


e 
as —— = d. 


ei 


Therefore, if we restrict the i’s of equation 1 by 
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we get the same members for R; as before. To show this, we need 
only to show that any set R, with these restrictions is equal to an- 
kK 


: al Ny" 
= 
other R, where one of the tj. > I m'/n;'. LetO Sa < —_, 


(seal, j 


: IT nj’ 
[ity oh i : Se (8 ny boon ta | 


os 


k 
= {in , t---+ dm’ +an; +----+ Gy}. 
k ‘> k 
By taking 7, = IT n,'/n,', we see that the term d II n,’ is already rep- 
l=1 t=1 


resented by the term i,n,, (i = 1, 2,----). This is so for all cases 


k 
where 1;., > I n,'/n;'. We could, however, take any of the 2;’s to 
t=1 
run through all the integers plus zero. It is not restricted to %,. 
If we generalize circuit C of Figure 1 to that of circuit C’ of 
Figure 2, we will note that if we change the value of 7, from that 


Deter se op 
Gate \ aN <it-R 


SS 


Panic mee 
a n 


FIGURE 2 


; k 
given on page 123 to7,=— [(k + 2) + > 1;], then the same sequence 
R;, will hold for C’ as for C. In other words, this generalization does 


k 
nothing more than add > 1; to all the members of the R, for C. 
This work was aided by a grant from the Dr. Wallace C. and 
Clara A. Abbott Memorial Fund of The University of Chicago. 
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Theoretical systems of neuroblasts differentiating according to vari- 
ous postulates are studied. The analysis determines the most likely pat- 
terns of connections implied by the differentiating systems. The exact 
expressions for the various parameters characterizing the resulting neu- 
ral networks are approximated by simple analytic expressions which 
hold for systems having large numbers of neurons. The study is pre- 
sented as a suggested approach to the more general problem of differ- 
entiating nervous systems. 


Experimental studies of growing nerve tissue, particularly the 
work of P. Weiss (1934, 1947), have led to some understanding of 
the factors which influence the orientation of growing nerve fibers. 
These experiments are important validating evidence for the conjec- 
ture that in general the differentiating neuroblasts of growing ner- 
vous systems are not individually channelized into highly specific 
loci of growth, but that the factors which are responsible for nerve 
fiber orientation act regionally. These factors (such as the “ultra- 
structural organization” of the medium of growth discussed by 
Weiss) are of such a character that the regions effected are in gen- 
eral far greater than the dimensions of single nerve fibers. The fac- 
tors controlling the average number of branches which will grow from 
each nerve fiber, the characteristic lengths and dispositions of those 
branches, and the factors determining the relative numbers of func- 
tional synapses which the fibers will form are still quite obscure. 

If we grant that future work will lead to a greater understand- 
ing of the “growth orienting factors,” “synapse forming factors,” 
etc., involved in the process of neurogenesis, we can anticipate still 
another problem which will then arise, namely, what “kinds” of neu- 
ral networks can be expected to develop as a result of such growth 
and differentiation factors. The general methods which may be de- 
veloped to approach this problem will probably be somewhat inde- 
pendent of the specific details of the process. 

More specifically, the problem is to: 


ee Postulate an initial spacial distribution of neuroblasts. 
2. State, in general terms, the factors which will act both spa- 
cially and temporally in the differentiation process. 
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3. Analytically derive the “types” and relative number of neu- 
ral circuits which should arise as a consequence of such as- 
sumptions. 


The problem as stated above, if carried out with biologically ten- 
able assumptions, implies such prodigious mathematical obstacles as 
to be forbidding. For this reason it was chosen herein to begin with 
some very simple postulates, tentatively sacrificing biological plausi- 
bility for the sake of developing the equations and “vocabulary” of 
the approach. The method of analysis thereby developed may then 
be hoped to incorporate progressively more complicated and biologi- 
cally tenable assumptions and thus slowly shed its purely theoretical 
character. Until such time as these latter developments materialize, 
therefore, discussions such as will follow in this paper must not be 
construed to depict any events occurring in actual developing nerv- 
ous systems. Any judgment as to the utility of such efforts will have 
to be postponed until such time as their implications have been much 
more thoroughly investigated. 


THE CASE OF Two AGGREGATES 


Distribution of Cycles. To begin with let us consider two aggre- 
gates (Fig. 1) of neuroblasts consisting of N, and Nz cells respec- 
tively. 

N, CELLS N, CELLS 


AGGREGATE } AGGREGATE 2 
FIGURE 1 


Let us assume that one non-branching fiber grows from each 
cell in each aggregate and is oriented to grow toward the cells of the 
opposing aggregate. Let us further assume that each of the growing 
fibers reaches the opposing aggregate and synapses on one of the cell 
bodies in that aggregate, the particular cell body being “chosen” at 
random. Note that these assumptions do not imply that each of the 
cell bodies will have at least one fiber synapsing on it, nor do they 
restrict the number of fibers which may synapse on any one cell body 
(aside from the restriction due to the finite number of fibers). 

The first question to be considered is: What is the probability 
C,(1) that a neuron randomly selected from aggregate (1) will bea 
member of a one-pair cycle, i.e., connected to a cell body in aggre- 
gate (2) which cell sends a fiber to the same cell in (1). According 
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to our hypothesis the neuron randomly selected from aggregate (1) 
sends its fiber to some cell in aggregate (2). The probability that this 
cell in aggregate (2) sends its fiber back to the selected cell in (1) 
is 1/(N,). Thus 


1 
Cy (1) 


Now let C,(m) be defined as the probability that a randomly se- 
lected cell in aggregate (1) is a member of an n-pair-cycle. By 
n-pair-cycle we mean a tandomly connected set of 2n cells forming 
a closed path alternating between aggregates (1) and (2). Figure 2 


= ne 
~ - 


AGGREGATE AGGREGATE 
I 
2 


FIGURE 2 


illustrates a 3-pair-cycle. 

If we now ask for the probability C,(2) that a randomly selected 
cell in aggregate (1) is a member of a 2-pair-cycle, we can use the 
following argument. A randomly selected cell of (1) can be a mem- 
ber of a 2-pair-cycle if, and only if: 

(a) The neuron in (2) to which it sends its fiber does not send 

one back to it. 

(b) The neuron in (1) (third member of cycle) does not con- 

nect with the second member of the cycle in (2), and finally 


(c) The fourth member of the cycle (whose cell body is in ag- 
gregate (2) sends its fiber to the originally selected cell of (1), 
thus completing the cycle. 


The independent probabilities (a), (b), and (c) are 
No 17 (Na Ne 1) / (Ns), 
and 1/(N,) respectively. The probability C.(2) of the occurrence of 


the composite event is therefore given by the product of the indepen- 
dent probabilities. Thus we obtain 


N,—1N.2—1 1 


: 2 
N, Ne Ni ee 


C,(2) = 
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By similar reasoning we obtain 


N,—1N2—1N.1—2N2—2 IL 
Ci (3) = oe (3) 
Ns N>2 N, Ne N, 


and, in general, 


C,(n) ak LE 
recat (4) 


2n — 2 factors 
X (N,—1) (N.—1) (Ni—2) (N.—2)---- (Nia—1+1) (N2—"+1). 


Having derived an expression for the probability that a random- 
ly selected cell of aggregate (1) is specifically a member of an -pair- 
cycle, we can now write an expression for the probability that a ran- 
domly selected cell of (1) is a member of any cycle at all. Since any 
one cell cannot be a member of more than one cycle, the probabilities 
C,(1), C,(2), ---- C,(”) that it is a member of any specific size cycle 
are mutually exclusive. Thus the probability C, that a cell of (1) is 
a member of any cycle is the sum of those mutually exclusive prob- 
abilities. Hence we obtain for N, < Ne 


C,=C,(1) + C,(2) + C,(8) +++. + C,(N;). (5) 


We will refer to C, as the cycle saturation of aggregate (1). 
Non-Cyclic Circuits. Neural connections other than cyclic can 
be expected to arise in the system. To illustrate the general disposi- 
tion of neurons which are not members of cycles, we may resort to 
the following device. Imagine that the neurons are threads which 
are tied to each other wherever a synapse occurs. If we would now 


BRANCHES 


LEADING 


tied — ee 
Sea TSO coc—~-o—" a 2 7> TO CYCLE 
o—_ 


FIGURE 3 


pick a length of thread which represents the last neuron of a non- 
cyclic chain (one which synapses with a member of a cycle) and hold 
it aloft, we would find (typically) that it would carry with it not only 
a single chain of threads but the numerous side chains would also 


connect to it to form a “tree” of connections. Figure 3 illustrates such 
a “tree.” 
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Having obtained an expression (equation 5) for the probability 
C, that a randomly selected neuron is a member of any cycle, we can 
now write an expression for the probability K, that a randomly se- 
lected neuron is a member of a tree. Since any cell which is not a 
member of a cycle is a member of a tree, we obtain for K, 
K,=1-—C,. (6) 
Now let K,(k,n) be defined as the probability that a randomly 
selected cell of aggregate (1) is a “loose end” (has no connection 
leading to it) and is a member of a chain of neurons which after k 
links synapses to a neuron which is a member of an n-pair-cycle. 
Since 1/(N,) is the probability that a particular neuron of aggre- 
gate (1) receives a connection from a particular neuron of aggre- 
gate (2), 1 — 1/(N,) or (N, — 1)/(QN;) is the probability that this 
connection is not made. Since aggregate (2) contains N. neurons, 
the probability that a particular neuron of aggregate (1) receives no 
connections from (2) is given by 


Caan 

Ni ; 
The probability that a particular neuron of (1) leads directly to an 
n-cycle is C.(n), hence the composite probability that a randomly 


selected neuron of (1) is a “loose end” which connects to an n-cycle 
is given by the expression 


N,—1 
K,(1,n) =( 


Ne 
) ccm). (7) 
ak 
If we now let N, = Nz and drop all subscripts, by a similar argu- 
ment we obtain 


K(1,n) =( Bea ) ow) 


K (2,n) =(=) (1—C)C(n) 
(8) 
K(3,n) =(~=)' (1—C)?C(n) 


ibe = (A ) (1—C)**C(n). 
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Similarly we can ask the following: What is the probability 
K(k) that a randomly selected neuron is a “loose end” which after k 
“links” leads to any cycle? Arguing as before, we obtain 


(9) 


His = ( <— ) (iC) Ge 


Note that 
K(k), C(n) 
Rie Bele 
As N grows large, the actual number (L) of “loose ends” in 
both aggregates approaches the product of the probability that any 


one cell is a loose end and the total number of cells in both aggregates. 
That is, for large N 


—). (10) 


pee ( Ne 
N 
On the other hand, the total number (7) of “trees” in the sys- 
tem is given by the total number of neurons which are connected to 
cycles, but which are not members of cycles themselves. Hence we 
obtain 
T=2N(1—=G)C. (11) 


The average number (B) of “terminal branches” in each tree 
can then be written as the ratio of L to T. Thus 


N=h\ a, 7 
Bea a—ao" a 


The exact expressions for the various probabilities thus far de- 
rived are written in general as series which for large values of N are 
cumbersome to evaluate and difficult to interpret. It can be shown, 
however, that for large values of N these series asymptotically ap- 
proach expressions of a much simpler character. 
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We will begin by writing the expression for the cycle saturation 
of the system in which N, = N, (equation (5) without subscripts) 
C=C(1) + C(2) +--+» + C(N). (13) 
Referring to equation (4) we can rewrite expression (13) as follows: 


bog eee CNET) GNi=2)° 


C= 
Ns Ne 
(14) 
i 1]2 
eee Se: 
N2N-1 


By multiplying both members of (14) by N,, factoring out 
[(N—1) !]2/Ne 


and writing the terms of the series in reverse order, we obtain 


N—1)!]? N* N24-2 
ee ee 1 ts 
N22 212! [ @N —T) !]? 

Now let 
N+ Né N2N-2 


E2(N) =1+ N?+ (16) 


+ —— + .... | ——___—_, 
Fit B13 [(N —2) !]? 


where the notation E,(N) was so chosen because the terms are the 
squares of the terms of the exponential series H(N). Then since 


[(N—1)!]?_(N})? 


; (17) 
N2N-2 N2% 
we obtain 
(NL)? 
NC — Arie E.(N). (18) 


By applying Stirling’s formula to the coefficient of H,(N) in expres- 
sion (18) we obtain 


este? 
(Ri Viegas (19) 
N2N e2N 
Thus equation (18) becomes 
22N 
NC=——- E3(N), (20) 


which reduces to 
2 
C=—E,(N). (21) 
e2N 
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A typical term of the series E.(N) for a given N can be written 


as 
2k 


(k!)?- 


f(k) = (22) 


By applying Stirling’s approximation formula to the typical term we 
obtain 


6 


k= = oN k-21 @ 6k oO Oe Ls (23) 


Let 6(k) = N** k-*4 then taking the natural logarithm of both mem- 
bers we obtain 


In 6(k) =2k in N— (2k +1)ink. (24) 
k 

Lettk = N(1+ t),t=—— 1. Now equation (24) can be written 
n 


In 6(k) =2N (1 +t) in N— [2N(1 +2) +1] m@N (147), (25) 
which can be written as 
In-o(k) =—i N.— {aN (1-0) int Peete (26) 


Now letting Z7=1+ t and p(Z) = (2NZ + 1) In Z, by differentia- 
tion we obtain 
p (Z) =2N InZ + (2N + $) 
Not 


Wh ee tee Se (27) 


2 
POUR see Ae NI) 
p” (2) == (4—N) 


By expanding the right-hand member of equation (26) in Taylor 
series (with remainder) with reference to equations (27) we obtain 


In o(k) =—InN — [pa += t+ = p"(1)¢ 
; (28) 
itt a+nnet, 


where 0 < 7 <1. Expression (28) can be written as 
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In 6(k) =—iInN— (2N + 1)t—4(2N—1)# 
(29) 


1 
rt A a Lae 


Returning to equation (23) and referring to equation (29) we can 
write 
f(k) oo ih e2N (+t) , i e-(2N-1) t-43(2N-1) t? M u(k) (30) 
22 N 
where 
u(k) Seg 


Rewriting expression (30) we obtain 
= 1 2N , p-i-}(2N-1) t? 
DE Sper reli i aa (31) 


which can be simplified to read 


f(k) = gs NaS ine 0/2 We (32) 


22aN 
Note that in the expression for u(k), 6 depends upon JN, and that 
for large N, u(k) approaches unity. Thus we obtain 


(k-N)?2 


N N 
ENS a eySe ¥ ; 33 
=i ) P28 ~ (33) 
we MeN)? 
E.(N) = ev fe EPIC 34 
2 ( ) 22N ‘ (3 ) 
- But the integral of expression (34) can be written as 
1 y _ (B-N)? 
e2N it CW OCOs (35) 
2a2N : 
Now letting 
Bee (ie uN) 
ace tN 
we obtain 
e2N 0 
E,(N) = ——— ee AG (36) 
Q/2aV/N °F 


For large N the lower limit goes to infinity, and the sum F,(N) 
asymptotically approaches the expression 
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e2N 


Avian N 


E,(N) = (37) 
Therefore for large N the cycle saturation C is given by the expres- 
sion* 

C= 3va/N . (38) 
Table I (below) indicates the accuracy of the approximate form (38) 


as compared to the exact form (14) even for small values of N . (Tab- 
ulated to three significant figures) 


TABLE 1 
N 1 2 3 4 5 
CXAch LOrmMineeece ee u .625 498 428 .082 
ODPLOX we LOrM ees .887 .627 512 444 396 
Op CLLOL eee eee —11.3 Bee 2.8 oat 3.6 


Returning now to equation (10), since 


; al 1 
ind saa lee shay 
Nw N 


we can write a simple approximation for L. Thus for large N 
2 
L=-N. (39) 
e 


In words, as the number of neurons of the system increases in- 
definitely, the number of neurons which are members of trees ap- 


J 
proaches a certain fraction of the total number, namely, —. On the 
e€ 


other hand, the total number of trees in the system equals the total 
number of “trunks” of such trees, that is, the number of neurons 
which are themselves not members of cycles, but are directly con- 
nected to neurons which are. This number, given by (11) is seen to 
approach 


T=\aN. (40) 


The average number (B) of “terminal branches” in each tree (an in- 


dicator of the configuration of neurons within the trees, for large N) 
then reduces to the expression 


* Cf. the analogous expression for the cycle saturation of a si 
in Rapoport (1948). - of uration of a single aggregate 
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2 
Bs Ne (41) 
evn 


THE CASE OF THREE AGGREGATES 
A logical extension of the case of two aggregates is the addition 
of another aggregate. This can be accomplished in two alternative 
ways which are illustrated in Figure 4. 


SSE SE SU 


N, CeLts No CELLS N3cELts 


AGGREGATE AGGREGATE AGGREGATE 
! 2 3 


AGERE AGGREGATE 
3 


b 


FIGURE 4a FIGURE 4b 


This discussion will limit itself to the “linear” alternative illus- 
trated in B of Figure 4, i.e., three aggregates linearly arranged with 
neuroblast numbering N,, N. and N;, terminal and central aggre- 
gates. Similar questions can be asked about this system as were asked 
about the two aggregate system. To begin with let Ci;(n) be defined 
as the probability that a randomly selected cell of aggregate 7 is a 
member of a cycle which traverses the path 1 > 7 ~ in times. Using 
the same elementary probability considerations as were employed in 
dealing with the case of two aggregates, we arrive at the expression 


1 n 1 
on =(5 ) axe 


(42) 
2i— Zractors 
(N,— 1) (N2—1) ---- (Ni —12 +1) (N2—n +1). 
Note that 
a. n 
Onin) =( 5) Cm. (43) 
3 aggregates 2 2 aggregates 


The reason that the probabilities C,.(m) and C,() differ by the 
factor (4)” is that every time a cell of aggregate (1) (in the three 
ageregate case) leads to the central aggregate, the probability that 
the cell to which it connects will return to aggregate (1) is 3, where- 
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as in the case of two aggregates the probability of return is unity 


(or certainty). 
Because of the “asymmetry” of the connections to aggregate (1) 


and (2) we find that Cy.(n) # C2: (”), explicitly, 


th TX? 1 
Cn (n) eTa 2 ) Ni," No" 
2n — 2 factors 


(N,—1) (N2—1) ---- (Ni — 12 +1)(N2—1 + 1) 


ro 


(44) 


from which it follows that 
Nz 
Cis (7) == Ny Coi (n) . 


Finally if we consider the terminal aggregates (1 and 3) we ob- 
tain 


1No.—111 
Cel) == 
api aa cee 
1N.— = Cie —— a 
GRO: PLN; 1N, 2N; 1 Nz ol 
2) gel ent oN Nz Nz Nee cus 
(45) 
: wel j y ‘ n— 1 factors 
13 a 5 Nin Nite eu a Ne 
2n — 1 factors n — 1 factors 
(N2—1) ---- (N.—2n + 1) (nm; — 1) ---- (Ns —n+4+1). 


If we drop the subscripts letting N, = N. = N; = N, we obtain 
a somewhat simpler expression for C,;(n), namely, 


n — 1 factors 
Caan) = ( : swe CY =21) aN : 
5 Niles )3(N — 2)8%.--. (N—n+1)3 


2n — 1 factors (46) 


(N—n) (N—n—1) ---- (N—2n+1). 
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Some interesting generalizations may be arrived at if this analy- 
sis were extended to a chain of k aggregates having N,, Nz ---- Nx 
cells per aggregate respectively. 

Concluding Remarks. 

The analysis presented here dealt with two very simple systems 
consisting of “neurons” which are capable of making only single con- 
nections. 

Subsequent analysis should perhaps proceed by introducing the 
complication that each neural element can differentiate large num- 
bers of branches many of which are capable of forming functional 
connections, Future work should also consider systems in which the 
geometry plays a significant role, thus making certain connections 
more probable than others. Gradations of “bias” can be imposed on 
the growth of the fibers until cases ranging from complete “random- 
ness” to rigidly determined structures have been studied. A paper 
by A. Rapoport (1948) takes some significant steps in this direction. 

The problem of choosing useful parameters by means of which 
a neural net can be characterized has already been met with in a 
previous paper (Shimbel and Rapoport, 1948). Suggestions for the 
improvement of nomenclature and selection of useful parameters will 
probably be determined largely by the dictates of future analysis. 

The author wishes to thank Drs. A. Rapoport and L. J. Savage 
for their generous assistance and critical discussion of this paper. 

This work was aided by a grant from the Dr. Wallace C. and 
Clara A. Abbott Memorial Fund of The University of Chicago. 
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CYCLE DISTRIBUTIONS IN RANDOM NETS 


ANATOL RAPOPORT 
THE UNIVERSITY OF CHICAGO 


Characteristics of random nets are derived from assumptions con- 
cerning the distribution of connections. The single aggregate of neu- 
rons with random connections without branching and two parallel chains 
with normal] distribution of connections are considered. The cycle satu- 
ration is derived for each type of net, that is, the fraction of neurons 
which are members of cycles. It is shown that in the single aggregate 
with random connections, the cycle saturation varies inversely as the 
square root of the number of neurons; in the dense two-chain net it 
varies inversely as the square root of the neuron density and inversely 
on the square root of the standard deviation of the normal distribution. 


I. Introduction. 


The first attempts to consider the behavior of so-called “random 
neural nets” in a systematic way have led to a series of problems con- 
cerned with relations between the “structure” and the “function” of 
such nets. The “structure” of a random net is not a clearly defined 
topological manifold such as could be used to describe a circuit with 
explicitly given connections. In a random neural net, one does not 
speak of “this” neuron synapsing on “that” one, but rather in terms 
of tendencies and probabilities associated with points or regions in 
the net. 

One could take the existence of such tendencies as one’s starting 
point, and, by applying probabilistic dynamics based on the funda- 
mental assumptions about the behavior of individual neurons (thres- 
holds, synaptic delay, etc.) derive the probable characteristics of be- 
havior for a net specified by certain parameters. Such has been the 
procedure in a recent paper by A. Shimbel and A. Rapoport (1948). 

One could also proceed in another way. One could assume cer- 
tain patterns of development for a net and then, again by applying 
probabilistic methods, deduce a probable structure for the resulting 
net, which, in turn, will imply certain characteristics of function. In 
the present paper, the latter approach will be used. 

We are concerned with the formation of cycles in neural nets, 
that is, structures represented by the following chain 


ar bree Pa, (1) 
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where a — b signifies that neuron a sends an axone which synapses 
on neuron b, etc. 

Cycles are of importance in the function of neural nets in the 
central nervous system, because they are the possible seats of perma- 
nent or semi-permanent activity. Given a cycle represented by the 
chain (1), it is evident that under the assumption that each neuron 
fires if, and only if, the neuron sending an axone to it fires, we shall 
have permanent activity in the cycle following the excitation of any 
of the neurons belonging to it. 

Consider now a net in which a certain fraction of neurons are 
members of cycles, while the remainder are not. If we now suppose 
that at a given moment every neuron of the net fires once, then, fol- 
lowing this initial activity (which is, let us say, imposed from the 
outside) there will be a certain residual permanent activity in the 
net, where the number of neurons involved will be the number of 
neurons which are members of cycles. Moreover, each such neuron 
will be firing with a certain frequency, depending on the number of 
neurons in the cycle of which it is a member. 

If neurons are restricted to sending one and only one axone, then 
each neuron will be a member of at most one cycle. If, however, this 
restriction does not apply, then a neuron may be a member of several 
distinct cycles. Such a neuron will be subject to a composite fre- 
quency of excitation. Thus let the neurons in Figure 1 all have thres- 


ae 
 FiGuRE 1° 


hold 1, and the synaptic delays all be equal. Then, if any one of the 
neurons fires, very soon every neuron will be firing repeatedly once 
per synaptic delay. Some aspects of such nets were discussed by J. B. 
Roberts (1948). 

_ Problems involving neurons belonging to more than one cycle 
will not be considered here, inasmuch as we are considering one- 
axone nets throughout. 

We define the cycle saturation of a net as the fraction of 
neurons in it which are members of cycles. By the cycle distribu- 
tion we shall mean the sequence of fractions of the neurons of a 
one-axone net which are members of 2-cycles, (a > b > a) 3-cycles 
(a> es c¢ > @), ---- s-cycles, etc. Thus the cycle saturation will 
determine the relative amount of residual activity in a net, following 
an initial stimulation, while the cycle distribution of a one-axone net 
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will give the distribution of the frequencies with which these perma- 
nently active neurons are firing. 


II. The Single Aggregate One-Axone Net with Random Con- 
nections. 


Consider a set of cells distributed in some region such that at a 
certain phase of their development, each cell sends an axone which 
eventually synapses on an arbitrary cell other than its own. Thus 
every cell sends an axone, but not necessarily every one receives one. 
Our aggregate of cells then becomes a single aggregate* one-axone 
neural net with random connections. In such a situation, if the num- 
ber of cells is finite, cycles must arise. Thus a 2-cycle will arise if a 
neuron receiving an axone sends its axone to the cell from which it 
has received it, etc. If N + 1 is the number of neurons in the net, 
the probability that a neuron will synapse on some particular other 
neuron is 1/N . Then the respective probabilities C; of the occurrence 
of k-cycles will be given by 


1 
Cc, =— 

N 

N— I 

N2 

yd — 
pe (NI) =?) 

N?2 
(2) 

pe WN 1) WN 2) 2 WN Be ) 
pee ae 

_(N—1)! 
a rr 


Since the probabilities C;,, are mutually exclusive, we get for the 
probability that a neuron is a member of any cycle (that is, the cycle 


saturation of the net) 
* Multiple aggregate nets are discussed by A. Shimbel (1948). 


148 CYCLE DISTRIBUTIONS IN RANDOM NETS 


Net Nt (N—1)! 


CNA) = (gists > —_—__—. (3) 
| 2 aa Noe 


For a small number of neurons, N + 1, C can be directly com- 
puted. We have C(2) = 1, which means that if the aggregate con- 
sists of only two neurons, both must be members of (the) cycle. Simi- 
larly C(3) =4+1=8/4, that is the probability of a neuron being 
a member of a cycle in an aggregate of three neurons is 3/4; C(4) = 
17/27; C(5) = 87/64; C(6) = 1669/3125, ete. 

For large values of N, it will be more convenient to compute 
NC(N + 1). From (3), we have 


I peal) (N—1)! 
NOS +.... 
N N@-) 
(N—1)! N2 N@-) (4) 
= prtn ee |. 
NG) Zt (N—1)! 


If N is large, the quantity (N — 1)!/N®° = N!/N*® can be 
approximated by Stirling’s formula 


NUN —\/ 2 Neem a (5) 
Thus 
N2 (N-1) 
NC~ V2aNe*(1+N+5— +... —_), (6) 
2! (N—1)! 
2 (N-1 
To evaluate en(1 +++.) é 
ot (N—1)! 
we use the formula* 
N-1 Nk (oo) 
Lim e* 5 —= s edt = \/ 25 


No k=0 k} V2n 0 


Substituting this value into (6), we obtain C= \/z/2N and state 
our result in 


Theorem 1. Ina large single aggregate one-axone net with ran- 
dom connections, the cycle saturation is given by 


C= Va/2N . (7) 


Corollary. The expected number of neurons which are members 
of cycles in such a net is 


* For justification of this approximation see J. V. Uspenski (1937). 
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(N + 1)C=\VaN/2 + Va/2N ~ VaNP2. 


Comparing the exact expression (3) for N = 5 with this ap- 
proximation, we have 1669/3125 ~ 0.53, while /x/10 ~ 0.56, that 
is the approximation formula gives C within 6 per cent even for an 
aggregate of six neurons. 


Ill. The Two-Chain Net with Normal Distribution of Connec- 
tions. 


Consider next two parallel rows of cells, each of which sends 
one axone to some cell in the opposite row, as in Figure 2. 


FIGURE 2 


The probabilities of connections are assumed as follows: We will 
designate an arbitrary pair of cells lying opposite each other in the 
two chains as the origin and the abscissa of each cell (its directed 
distance from the origin cell in its own chain) by x for the upper 
row and y for the lower. Then the probability that the axone from 
x synapses on y or that the axone from y synapses on & will be as- 


sumed as 
-(2-y)? 


e@ 20? (8) 


(a) a ee emcee 
o\V/2n 
where 6 is the distance between two successive cells in a row, and o 
is the parameter of standard deviation in the normal probability dis- 
tribution 
—f2 


See 
Ces, 


w(t) = 


oV2n 

It is assumed that 6 is small compared to unity, so that the two 
chains can be considered as linear continua. 

Our problem is to compute the cycle saturation of the net re- 
sulting from the connections occurring as described by equation (8). 
We will need the following 

Lemma. The quadratic form 


Q(r) =— #2 + U1%_ — Lo? + Los °° + Vp, — $0,? (9) 


may be written as 
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1 2 3 2 ) 4 ( 3 ) 
oo ay awe Cy Sw 4 bp ea 
(« 5 | 4 («: ana 6 el 


“—=( oie, ) 3 4 
— +... ——— | &, — —_ ——hehere re aly. 
2k ie oe 


Proof. The relation obviously holds for r= 2. We will first establish 
an induction on the coefficient of the kth bracket. Suppose, therefore, 
that the kth term of (10) is given by (k +1) [%.— kann / (kK +1)]?/2k , 
and let us compute the (k + 1)th term. If the kth bracket of (10) 
is expanded, the coefficient of 77x. will be (k + 1)k?/2k(k + 1)? = 
k/2(k +1). But the coefficient of 27... in (9) is unity. Therefore an 
additional «?,., term must appear in (10) with coefficient equal to 
1— k/2(k + 1) = (k + 2)/2(k + 1), and that is the coefficient of 
the (k + 1)th bracket. This proves the induction on the bracket co- 
efficients. 

To prove our contention concerning the coefficients of the second 
terms within the brackets, we note that in the expansion of the kth 
bracket of (10), the coefficient of the cross-product will be 


Onss (hk ag 1) /k ) 


where ax,, is the coefficient of 2%. within the kth bracket. But the co- 
efficient of 21.4. in (9) is unity. Hence a. = k/(k + 1) as desired. 

Finally the coefficient x,2 coming from the last bracket of (10) 
is (r— 1)/2r, and it is 1/2 in (9). Hence the coefficient of the last 
term in (10) must be 1/2 — (r — 1) /2r = 4r as desired. This proves 
the lemma. 

Before we proceed to the computation of the cycle saturation of 
our net, we will first consider an 

Associated Random Walk Problem. 

Let a particle suffer displacements from cell to cell, such that 
each displacement is always to a cell in the opposite row, and let the 
probability of each displacement be given by equation (8). We seek 
the probability that after 2s displacements the particle returns to 
its original position. 


(10) 


Theorem 2. The probability of return to original position after 
2s displacements in the associated random walk problem is given by 


6 6? é* 
a —|1- a hay ; (11) 
20\V/as 12s. 6As? 


Proof. Without loss of generality we can suppose that the par- 
ticle starts its random walk at the origin in the upper row. Then, 
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denoting by «’s points in the upper row and by y’s those of the lower 
and considering the two chains as continua, we have 


ey tees 6/2 
Ihe ol J 0 | 
~ 8 (2a)° 7) ° -6/2 | Die ee 


(12) 
X [—y? — (Yi — 41)? — (4, — Yo)? +» — 2,7] 
dy, dx, dy. ----dx,. 


Note that the polynomial in the exponential bracket may be written 
as 

o (9 + Ys, 8? + Ly, —- +s — $257) (13) 
that is essentially as the quadratic form (9), which by our lemma may 
be written in the form of (10). Therefore 


1 Oy a es 
Z,.=—— | | i Exp | 6 
o28 (2 mt) 8 8/2 a4 an 
de ay Va HS 2 \ 
[-(»—5) , (=x) (14) 
a 
va -_3 || a dity +++ dity. 


All the terms of the exponential after the first one are independent 
of y,; all the terms after the second are independent of x, etc. The 
integrations can therefore be eee on the exponential functions 


of the type 


—a; (L-Y)? 


e ? (G22 St 2o9. Zo) 2 (15) 


Each infinite integral of this type yields a factor, oV/x/a;, and 
we obtain, after performing all the infinite integrations, 


1 28-1 
Zs = =“ 2st 7 8-1) TT (a;) =t 
oo (2 nt) 8 ras 
(16) 
6/2 
x { ewt/4s dy,. 
-5/2 


Furthermore, 2\i Seeouet | 
Fra Civil eae ae me a riey RO 
: 234 2s 


t= 
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Hence, 


1 5/2 
La i! e#7/48 dyx,. (18) 
oVn SY -0/2)% 


Expanding the integrand in series, integrating term by term, and 
factoring out 6, we finally obtain 


6 6? 64 
Z = 1— = BF. 2 
ons 12s 64s? 
This proves the theorem. 


For 6 << 1, as assumed above, the result reduces to 
0) 


oV/n 


i 


(19) 


” 


Computation of Cycle Distribution. 


The quantities Z, (except Z,) do not give the probabilities of the 
corresponding types of cycles. Consider Z, as the probability that 
the origin sends an axone to a cell at y, in the lower row, which sends 
one to x, in the upper row, which sends to y., which sends to 0. This 
situation will describe a 2-pair cycle only if 7, # 0; y:1 # y. For 
suppose that x, = 0. Then the firing of y, will imply the firing of 0, 
which will again fire y, , and we shall have a 1-pair cycle only. The 
neuron at y» will never fire under these conditions. A similar situa- 
tion will result if y, = y.. In general, the scheme 


0 > Yi > X1 > Yo > Lo +++ Ys 70 (20) 


will be an s-pair cycle only if all the x’s are distinct and not equal to 
zero, and all the y’s are distinct. That is to say, the path (20) will 
be an s-pair cycle, if, and only if, none of its neurons are members 
of cycles of order less than s. 

If we denote by C, the probability of occurrence of an s-pair 
cycle, we have 

Q=41; C.<Z, (s>1). (21) 

We seek to express the C, in terms of the Z,. To do this, let us 
first compute C, . 

The expression for C, will be quite similar to that for Z. in equa- 
tion (12) except that the infinite integrals will be taken not over the 
entire infinite interval (—«, «) but over a selected set of points, 
namely, over those points in the interval where cells which are not 
members of one-pair cycles are located. Since we may suppose that 
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cells which are members of different cycles are uniformly distributed 
over the whole infinite integral, the restriction of the domain of in- 
tegration means merely the reduction of the Lebesgue measure of 
each unit interval from unity to the Lebesgue measure of the set of 
points which are not members of one-pair cycles. The Lebesgue meas- 
ure in a unit interval of such points will be 1 — C,. Since three of 
the variables (y, 71, %2) are restricted to these point sets, we shall 
obtain C, if we “weight” the integrand of (12) with the factor 
(1 — C,) three times, that is 


1—C,)? po? pe pe pe 1 
ga BaO FEL nlc 
220% -6/2 0 -00 —0o 20° 
a oe (2, — Ya) = oe dy, +-++ day (22) 


= (1 — C,)* Z.. 
Similarly, 
C,;= [1— (C,+ C.))° 23, (23) 


and in general 


s-1 28-1 
o=[1-z4e | Zé (24) 

ia4 
Equation (24) gives an iteration formula for the C’s, where Ce, 
we recall, is the probability of an s-pair cycle. Since the probabilities 
of each type of cycle are mutually exclusive, we obtain for the cycle 
saturation of our net 


c=3]1-d0, tie Ze (25) 


4=1 


Computation of Cycle Saturation. 


We are now prepared to compute the cycle saturation in terms 
of the parameters of our net (6 and c). Since the Z, are easily ex- 
pressed in terms of these parameters, cf. equation (19), we will ex- 
press C in terms of the 2’s. 


Theorem 3. Let the sequence of quantities z be defined as fol- 
lows: 
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2=1 
7— 1 S= Zi 
2" = 2'(1— 2? Ze) 
o) sme" (1, et" Zs) (26) 


20) 20-1) [1 es (20-9) 29 Z; | ze 


Then the cycle saturation of the two-chain net with normal dis- 
tribution of connections will be given by 


C=3 (20-0) 2-1 Z, = Z, + *Zq + 2"Fy Fo (27) 
j=l 
Proof. We have seen that C; = Z,. By the iteration formulae 
(24) and (26), we have 
C,= (1—2,)*2Z, = 272, 
C,= (1—Z, — 2°Z,)°Z3= (2 — 2%Z2)°Z3 = 2"°Zs 
C, = GE ae Vhs Fr 2°23 ae 2 La) LW 
= (2 — 2"°Ze— 22s) 'Z. = Lay CR 
Summing over the C’s we obtain (27). This proves the theorem. 


Corollary. If the approximation (19) is used for the Z’s, the ex- 
pression for the cycle saturation of a two-chain net becomes 


é 2’)3 2" 5 
o= (1+ S04 oe 
2o0\Va V2 V3 
~° (j-1)'] 23- 
fy) _S [Z%-)] eae 
2a nie V5 


(29) 


Remark. The series in (27) converges, because it is dominated 
by the geometric* series © (2')”. This is true, because the 2 form 


a monotone decreasing sequence of positive terms, all less than unity, 
while the denominators of (29) further decrease the absolute value 
of each term. 

However note that the series converges very slowly, since the 
first several numerators are very close to unity, so that at first the 


* Geometric because z’ = 1—Z, <1. 
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series behaves like the divergent series ¥ SS 
N=1 Vn 
One may get an upper bound on C by noting that 


rs) foe) I\ 27-1 
Cx =f1+s |. (30) 
2 V9 


: roa) Ze 
Evaluation of 5} ———. 
ie Vj 
Let (2) = #.. ‘Then 
foe) (2') 274 1 (oe) Ri 
Pies (31) 
PON SEPALS 3 
; aga 
We will evaluate ¥ —. Note that this series is dominated by the 
1 WJ 


integral it —dzx. Let x = (— logge) y. 
We 


oo R« oO 
— dx = if e¥ (— logre)? y} dy 
Vx 


0 0 


= (—logre)! I'(1/2) = (— loge)! Va (32) 


0 


Then 


Fe 
= \/a(— logge) = ——_—_.. 
ia log. 
Therefore 2 
5 Anes ek, Va aon * Vn (33) 
jz Vi 2’ (—log-R)' 2 V/2(— loge’)? 


and we have 


Theorem 4. For small values of 6 (and therefore of Zi) an up- 
per bound on C, which near Z, = 0 is also an approximation, ws given 
by - 

IU 
o~z,[1+—____* ____ | : (34) 
V2(1 — Z,) (— loge[1 — Z|)? 
Remarks. When Z, << 1, the second term in the brackets of 
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(34) is very large compared to unity. An approximation of C may 
then be given by 


C a Vio 
‘i 2 (1—Z,) [—log(1— Zi) }* 
Note that C is a function of Z, and therefore of 6/c. However, 


we may write C as a function of our original parameters, 6 and o, 
by substituting the value of Z, given by (19). Thus we obtain 


%) 
OS SSS eee 
2\/20 (1 — 6/202) [log (20a) — log (20V/a — 6) J? 
The Behavior of Cycle Saturation and Cycle Density for Large 
Neuron Density. 


(35) 


The neuron density and the cycle density of a chain net may be 
naturally defined as 1/6 and C/6 respectively. When 6 <<1, the 
neuron density is large. 

If we assume that also 6 << oc, that is Z, is small (which as- 
sumption underlies the whole treatment of the chain net), we can ap- 
proximate C in the vicinity of 6 = 0 by expanding the functions of 
Z, involved in expression (35). Thus 


—log(1— Z;) ~ Z,(1 + 42,4) 


= 


4 Ti ‘ 
~ 24 Peo aee ee Pi 
4 


— log (1 — 7;) 


(1—Z,)72~14+Z,+Z2+--- (37) 


hs Pagal \ Ly 2 
o~ J 3 at+ m+ Ze+--9(1- 24% ten) 
2 4 32 


ee Ao 
2 


Substituting for 7, its value given by (19), we obtain 


ani/4 } 


2 o 


mi/4 1 
C/6 ~ a eae 
/ 2 7) 


We embody these results in our final 


~ 
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Theorem 5. For large densities of neurons (6 << 1 and 6 << a) 
the cycle saturation of a two-chain net with normal distribution of 
connection probabilities is approximately proportional to (6/c)}, 
while the cycle density is approximately proportional to (6 c)-?, the 
constant proportionality being 4n™*. 


Corollary. The cycle saturation of a dense two-chain net varies 
inversely as the square root of the product of neuron density and 
standard deviation. 

The author wishes to acknowledge his thanks to Dr. L. J. Savage 
for a critical discussion of this paper. 

This work was aided by a grant from the Dr. Wallace C. and 
Clara A. Abbott Memorial Fund of The University of Chicago. 
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ON PERIODICITIES IN METABOLIZING SYSTEMS 
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Following a previous study by A. Weinberg, the author investigates 
periodical diffusion phenomena produced in a spherical cell by a simple 
coupled set of chemical reactions. The general solution even for a 
spherical cell does not possess spherical symmetry. It is found that pe- 
riodic oscillations are possible with a frequency spectrum determined by a 
set of “eigenvalues.”’ However, these oscillations are all damped even if 
the system of coupled reactions which is responsible for them has non- 
damped solutions. Therefore, although very complex and highly asym- 
metrical configurations of concentrations may be thus produced in the 
cell, none of those configurations, except some possible centrally sym- 
metric ones, is lasting. 


Following a suggestion by the author (Rashevsky, 1938, chap. 
vi; 1948, chap. vi), Alvin M. Weinberg (1938) studied periodical dif- 
fusion phenomena produced in a spherical cell by a simple coupled 
reaction. He limited himself, however, to solutions which possess 
spherical symmetry. The periodicities are due to the fact that a sys- 
tem of two first-order differential equations is formally equivalent 
to a single differential equation of second order. This problem for- 
mally resembles, therefore, the problem of elastic vibrations. In the 
cases of elastic vibrations a system with central symmetry, for in- 
stance, a circular membrane or disk, possesses stable solutions which 
do not have central symmetry. It is therefore of interest to investi- 
gate the possibility of a similar situation arising in the case of peri- 
odical diffusion fields, and whether, as a result, all kinds of nonsym- 
metric diffusion configurations might appear in a spherical cell. 

We shall denote by c;; and cj. the concentrations of the two re- 
acting substances inside of the cell, and by ¢.1 and ¢,. the correspond- 
ing concentrations outside of the cell. At an infinite distance from 
the cell c,, and ¢,. reduce to ¢); and ¢o2. The diffusion coefficients for 
the two substances inside of the cell are denoted by Dj, and Diz, while 
outside of the cell they are denoted by D,, and D... The permeabil- 
ities of the cell membrane are h, and h,. Denoting by 1, G12, G21, 
and a». four constants, which may be positive or negative, we assume 
the following expressions for the rates of production q, and q, per 
unit volume of the two substances inside of the cell: 
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G1 = Ar1Cia T A2Cia 5 
(1) 
Qo = Az1Ci1 TF AoeCia « 
Denoting by V? the Laplacian operator, we find for the diffusion 
equations inside of the cell: 


Cia : 

t = DiV Cia + Airis 1 AieCi2 ; 

(2) 

0Ci2 

at = DigV Cig + AerCi1 HF Age Cie. 

Outside of the cell we have 

OCe 0Ce 

sp Davee 5 Sp Daves. (3) 


At the boundary we have, denoting by r the radius vector from the 
center and by 7, the radius of the cell: 
For 7 = fo: 


OC; OCe 
Dis — = — I (Cis — Cer) = Daa —; 
or or 
4 
OCio OCes ( ) 
Diz =— he (Cie — Cea) = Dez —.- 
or or 


We shall now reduce the system (2) to a simple partial differ- 
ential equation of second order int. 
The second equation of (2) gives: 


b 1 Q€is Diz v2 Qe (5) 
= a ae op 4) Catone: 
‘ Chel ails Aha 4 Ay, : 
Differentiating with respect to t, we find 
OC wi: 1 07Cio Diz 0 Ass OCis 
ain met Elen aos ea (6) 
Ot Go, Cl" Go, Ot Gor, 0b 


Introducing equations (5) and (6) into the first equation of the sys- 
tem (2), putting 


0*e . 0*¢ Z 0*e ‘ 
V4Cia = V2V2Cig = i2 4 iz bi: 
Oa* oy* 0z* 


(7) 


“ 0*Cis O*Cio 0*Cio 
ax0y? da20z2 oy2022” 
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and rearranging, we find: 


BE (Qy1 + Ge) fa: (Dix + Diz) ce V Cie 

ot? ot ot 

+ Di DieV*Cig + (QxDia + AuDi2) V Cie (8) 
+ (Qy41%22 — Ay2A1) Cig = 0. 


Solving the first equation of the system (2) for Cis , differentiating, 
and introducing into the second equation of the system (2), we find 
in a similar way 


ads (dis + doo) eee (Din 4eDis) oy 
eg NO Ae = i Pe Pe i 
at? Shere <a GE pil cinta 
+ DaDeV*ein + (QuDie + O2D,) V72Cu (9) 


F (Q025 — Qy2Me1) Ci = 0. 
Subtracting equation (8) from equation (9) and putting 


Ci1 — Cig = Di, (10) 
we obtain: 


0°®; 
ot? 


0®; 0 . 
— (dy, + dee) Payot (Dis + Diz) at V7; 


ae Diz Dio V 48; aie (Q11D in =e Qo2Dj1) V7; (11) 
+ (Qi22 — AreQe1) 0; = 0. 


System (3) differs from system (2) essentially only in that the 
coefficients @4; , Ai. , Mo, , ANd Az. vanish. 
Therefore, putting 
eo, cn = ¢e5 (12) 


we see that the system (3) is equivalent to 


07@, 0 
rae (Ds ar De) Ie V7, + DaDe2V*8¢ — 0. (13) 
ot? ot 
This can also be shown directly. 
Put 
= Cate Cars (14) 
so that 
— —— Cc (15) 
Ce 9 2 9 


Introducing this into (3), we find: 
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ee ay ee (16) 

ot ot 

®, 
sae = DeoV*U — DeoV? Be. (17) 

ot ot 

Subtracting (17) from (16) we have 
Oe 

2 ot == (De — Da) Ci a a ee (18) 


From equation (18) we have: 


v24 = oq — — ——“— 2D ee (19) 


or, 


2 e7bs* Dat Dee 
: at ees BO (20) 


ot DADs ot? Da= De ot 


Applying the Laplacian operator to both sides of equation (16) we 
have 


f) 0 
-— V0 + = VO, = Dav + DaV ‘*e.. (21) 
ot ot 
Similarly, from equation (19) we have 
me 0 Dex “Up Ds 
V4u = ————__ — V6, — ———__ V'‘®... (22) 
Dea Dee ot Da— De 


Introducing equations (20) and (22) into equation (21) we obtain 
equation (18). 

In order to obtain the boundary conditions for the systems (11) 
and (18) it seems to be necessary to make the same restrictive, 
though not implausible, assumption as made by A. Weinberg, namely, 
we put 


hy h, =f Da _ Da, 23) 
Dis Diz ac Dis Dig ae \ 
In that case we obtain from equaticns (4): 
Forr=n": 
hae ae ae 
, or LE ~— ye (24) 
00; 08, 
=k (25) 


or ae! 
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Any solution ©; of the equation 
Dj, Di2V*® + (AuDi2 + Ge2Dj1) V7 


(26) 
+ (A41Ae2 — Ay2M2,) & = 0 
is also a solution of equation (11). 
Hence the solution of equation (11) may be put in the form 
So," + o,; (27) 


where %,; is independent of time, while ®;* depends on it and satisfy 
the general equation (11). 
Putting 

&; = ye", (28) 


where ¥; is a function of the space coordinates only, introducing this 
into equation (11), and putting 


QnDis + OnDix — (Din + Dio) v 


—= 01; ; (29) 
DizDie 
9? — (Gq + On)” + O41022 — AE02; ase (30) 
DiDie 
we find 
Vidi + aV'ti + oi = 0. (31) 
Consider the equation 
Vb; = A725, = 0, (32) 
where J is a constant. 
From that equation, we have 
V4y, + 20%; =0. (33) 
Put 
y emir ha oe hae (34) 
Then 
Viti = (A +A") Vi =0 (35) 
or, 
Vids SAV = A"V7i = 0. (36) 


Substituting equation (32) into the last term of the left-hand side of 
equation (36), we find: 


Als eeid Vive ALw aa. (37) 


Put 
XV = 1. (38) 
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Hence, because of equation (34) 


AS At ee (39) 
Introducing (38) and (39) into (37) we find 
V4di = a V2bi — (A? — 1) 7 = 0. (40) 
Equation (40) becomes identical with equation (31) if we make 
(P— a) 7 == ee (41) 


Since the plus:sign appears before a, in equation (31), any solution 
of the equation 


Vb, + Avi =0, (42) 
where 4? is expressed in terms of a, and a, through equation (41), is 
also a solution of equation (31). 

When we try to satisfy the boundary conditions, we shall find 
that this can be done only if 4? has certain discrete values which are 
the eigenvalues of the boundary problem. In general, for each eigen- 
value of 4? we obtain a pair of values of » in equation (28). This is 
seen in the following way. 

Equation (41) may be written: 


A* — a,A? aa ii =p) ’ (43) 
and its roots are 


j Comes ee 

eae oe Rae res (44) 

Introducing into equation (44) the expressions (29) and (30) we 

find after laborious rearrangements the following quadratic equation 
for »: 

wt [AA (Dix + Diz) = O17 — On] ¥ HD GD 

(45) 

mot (@4,D i an AyD) + Qy1Q22 — AyoA21 = 0. 

In general » will be complex, and expression (28) will thus rep- 
resent a damped oscillation. The real part of » is zero only for a par- 
ticular value of 12, which makes the coefficient of » in (45) vanish. 
Unless this value happens to be an eigenvalue, we thus see that all 
oscillations are damped. For some values of 42 the damping may be 
negative, which means that for the vibrational configuration corre- 
sponding to that value of 4? the whole system becomes unstable. 
Similar considerations may be applied to equation (13), by first 
putting 


d, = Doe ai &," ’ (46) 
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and then putting 


b= ye". (47) 
This leads to the equation 
Vive + a1V te + ote = 0 (48) 
with 
baad De == De =~ a ye? 
Ch Ss ee 2— 6 
ep Samu eds Ne 
Equation (48) is equivalent to 
Vive 176.0 (50) 
with 
~ Or i e (51) 
a= 1 0 40. 
oN 2 


A solution of equation (42) in polar coordinates is given by 
(Schmidt, 1934): 
, 1 psy 
Wi (%, $0) =S—J ar) Ss jane cos (nd) 
n=0 


ihe s 
™m of 


(52) 
“fs b,™ sin (np) | Py (cos 6) ’ 


where J denotes the Bessel function of order m + 3, P,,‘” is the 
nth derivative of the Legeandre polynomial of order m; @,°”, b,™, 


are coefficients. 
Therefore, a solution of equation (11) is given by: 


N=TV 


1 
i (1, $61) =Y—I,, (ir) B | an cos (ne) 
Vt Mt+e 


m™ n=0 
+ b,™ sin (Nd) P,,™ (cos 6) (538) 
[Ca evalaAyt + Co ev2()t] ; 


where »,(1) and ».(A) are the two roots of equation (45) and Cmnv, 


and Cnv, are coefficients. 
Similarly, equation (13) for ® is solved by 
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n=m 


, 1 - a 
(7, $,8,0) =T—I,,, (ir) B | Gaim cos (ng) 


m Vr n=0 
+b, sin (nd) | P,,,™ (cos 6) (54) 


[Cn enMe + C2) eet] , 
The functions 4; and 6. must satisfy the boundary conditions (24) 
and (25). 

It can be readily seen by putting a1, = Ges = Ay = M2, = 0 in 
equation (45) that for any real value of 7, the quantity » is real. If 
all the constants in equation (45) are so chosen that the same thing 
holds about », then we can use the following device. 

Denote 


m+t 


d 1 
TnQ;7) =" |=s (ar) |. _ (55) 


Let v,(A) be the root of equation (45) which corresponds to the 
minus sign before the radical in the solution of that equation; (the 


smaller root, if they are real). Let ».(A) be the other root. Let », (A) 


and ».(4) have the same meaning for the two roots which are asso- 
ciated with equation (48). Consider first the particular case of (53) 


and (54) where C,, = C,,® =0. 
Let 


Vy (4) =» A) (56) 


This establishes a relation between 1 and i, so that the former 
becomes a function f,(1) of the latter: 


A=fi(d)o (57) 
Consider the values of oe (ar) and T,,(7,r). We have 


J, Ar) =F A G)r)] = Un (4,7) ; (58) 


m+ m+ 
Tn(A") = T mf: (A) 71] = Vn (Gr). (59) 
Substituting this into equation (54), we find, because of (56): 


n=m 


1 a4 
Ge (7, 4,0, t) =S—Un(A,r) & Gn COs (N $) 
mV/r n=0 


(60) 
cin b,™ sin (n $) | Pain (cos 6) Cae evrayt 
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ie Introducing expressions (53) and (60) into the boundary con- 
ditions (24) and (25), and equating the coefficients of identical terms 
in ¢, and 6, we find: 


m+4 


ky 
To 4h4 To) + ores) (A, 0) |e 
Vo 


k (61) 
— = Ua Q ’ To) | Gy ™ 
Vo 
and 
Ye (A, To) | ed or [heVin (A, To) | a, ™) : (62) 


Similar relations hold for b,“” and b,,™. 


If equations (61) and (62) hold for any values of a, and a,™, 
then we must have 


key 
| Tm(4, 70) tad, (ste) ]eYaG.r) 
WX ae 
: (63) 
==— Tn (25, to) Um (A, Mo) « 
Vo 


The roots of the transcendental equation (63) are the eigenvalues 
An (m= 1,2,3----; w= 1,2, 8----) of our boundary problem. 
These values satisfy conditions (61) and (62). But then the ratio 
b,™ /b6, becomes fixed and thus either only the b,‘”’s or the b,”’s 
can be chosen freely. Putting 


bn” = Vala ’ (64) 
we now have a particular solution of equations (11) and (18), satis- 
fying the boundary conditions (24) and (25): 


m 


oOo 1 
#7, 68, =¥ BI, Unltr) B | anim cos (n 6) 
a n=0 


m=0 P=1 
(65) 
+ b,™ sin (n ¢) | Pat (COS 87) Cn le NOI es 
and ia ai ! e 
oOo © 1 Lae ee 
b,° (7, ¢,0,t)= > > — UA,” 7) an, ™ cos (no) 

m=0 H=1 Vr n=0 

(66) 


a Vann sin (n $) | Pat (cos 6) Cin D Erm Et, 
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It must be remarked that although from a mathematical point of 
view the summations in equations (65) may be extended over all val- 
ues of m from 0 to « , nevertheless from physical considerations the 
value m = 1 should be omitted. The reason for this is that the deriva- 
tive of Jz.(r) is not equal to zero at r= 0. But in the absence of any 
point sources at the center, the derivative of 6; must be continuous 
at r = 0. This remark holds also for the subsequent equation (72). 
It does not apply, however, to (66) and (73), since in both of tes 
if Ry 

Now consider the case where C,,°) =C,, = 0 in equations (53) 


and (54). Let 


veh) =e ae (67) 
This establishes a relation 
Lei Aye (68) 
which is, in general, different from relation (56). 
We now put 
Jo Att Ail Ge etal (69) 
Ei(ay 1) =D Lie A). Vey). (70) 


By a similar argument as before we now find that the boundary 
conditions (24) and (25) are satisfied by (53) and (54) if 


| 


m 


a To) | kkeVn(A » To) 


“ C71) 
: £ 
= Ss (NGS To) Un ’ To) . 
Vo 
This equation gives another set Jn‘ of eigenvalues, and we ob- 
tain as another particular solution of equations (11) and (18): 


m 


J 
Gi (7, 4,0, t) = > > —= 4 Gar) 2S {ami cos (” @) 


M=0 =1 Vr 
(72) 
+ 6,™ sin (n ¢) a (cog 0) C,( ev(mnt » 
and 
.(r,¢%,9,t) = > > a * Flin”, r) = 3 | a, ™ cos(n ¢$) 
m=0 N=1 Vr 
(73) 


+ ymbn™ sin (n $) Pr (cos 0) Cm eve) « 
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with y,, different from ym, Which appears in (63) and (66). 

The sum of (65) and (72) and the sum of (66) and (73) form 
also a solution of equations (11) and (13). 

A particular solution of equation (13) is also obtained if in ex- 
pression (54) for ®, we substitute a (Ar) for Lie (ar). Wemay 


satisfy the boundary conditions in the same way and obtain a solu- 
tion of 6;" (r,¢,6,t) and 6,” (7,¢,6,t). The functions 


© ;* — A,®; =F A,®;” Se A,®;”” ; 

©," = A,®, + A,” + A,6,”” ee) 
where A,, A,, and A; are arbitrary constants, 6; and ®, are given 
by (72) and (78); and 6;” and ®,” are given by (65) and (66) ; are 
again solutions of (11) and (13). 

The functions 6;* and ©,” are oscillating with respect to the vari- 
ables 7, 6, and 6, and assume in some regions negative values. The 
circumstance that #;* and ®,* become negative does not necessarily 
imply that either of the quantities ¢;,, Cis, Ce, OY Ce. become nega- 
tive. In general, however, this may happen to be the case. 

The complete solutions of equations (11) and (13) are, however, 
given by expressions (27) and (46). As long as the amplitudes of 
the oscillations of ®;* and @,* are less than the smallest values of &o; 
or ®), in the corresponding region, the complete solution has physical 
meaning. The above requirement puts certain restrictions on the co- 
efficients A,, A., and A; in expressions (74). This is analogous to 
the requirement expressed by relations (22) of chapter vi of the au- 
thor’s book (Rashevsky, 1938, 1948). 

If, however, some values of », as given by equation (45) are 
complex, the above procedure cannot be used because we now cannot 
satisfy (56). Whether we still can satisfy in general the boundary 
conditions (24) and (25) in that case is a question which we do not 
attempt to answer here. Those boundary conditions may, however, 
be satisfied for the special case Da = Da = 1; & = 0. Introduc- 
ing for this case (53) into (24) we find 


ofa (r) + ay (Aro) = 0 

dr Vr m+t = / m+} 

as the equation which determines the eigenvalues. Then by a similar 

procedure as above we can obtain a solution ©;" which oscillates with 

respect to time also. It gives periodic oscillations inside of the cell. 

As we have seen, however, these oscillations are, in general, damped. 
Let us now investigate the solutions of %o; and Poe which do not 


depend on time. 
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Putting 
A4,Di2 + AeeDir — £:; 11 A29 — Ar2Me1 =f, (75) 
DinDiz DiDiez 
we reduce equation (26) to the form 
Vio + £, V6 + B.b=0. (76) 
According to what was said above, any solution of the equation 
Vb +rb=0, (77) 
where 
et 
cab #5 be —46 (78) 


is a solution of (76). 
Equation (77) is of the same form as equation (42). There is, 
however, a great difference between the two. Whereas the parameter 
42 in equation (42) is variable, and is determined by the requirements 
at the boundary, the parameter x? in equation (77) is a fixed physi- 
cal constant. 

The solution &,. satisfies the equation which is obtained from 
(18) by making all derivations with respect to ¢ zero. Thus ®o¢ is 
the solution of 


VAbi— 0G (79) 
which has the same solution as 
V2b=0. (80) 


The general expression for such a solution of (80) which at in- 
finity tends to a constant value ®) = ¢o1 — Co2 is given in polar coor- 
dinates by 


Doe Ci o, 6) pe ®y a >) y-m-1 | 00 eos (n ¢) 


n=0 
(81) 
+ Qn™ sin(n ¢) | Pn™ (cos 6) , 


where p,™ and q,™ are coefficients. 

If both values of «?, as given by equation (78), are positive, then 
for each value we may still satisfy equation (77) by an expression 
of the form of (52). Introducing this and (81) into the boundary 


conditions (24) and (25), and again equating term by term we come 
to the relations 
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J (ks) | C.K, rom ~ (82) 


| Po (e570) =r ea 


and 
[Pm (k, %o) | On =— ky (m + 1) 19"? py™ . (83) 


The above two relations require 


ky 
— alm + 1yrem? | Tale, 70) beers oh (70) | 
Vo U+2 


=k, rom YL (or fee (84) 


But this relation is, in general, not satisfied for any x. Hence 
the only term for which the boundary conditions (24) and (25) can 
be satisfied is one that does not contain either ¢ or 6. The problem re- 
duces to the one discussed in detail elsewhere (Rashevsky, 1938; 1948, 
chap. iv). As has been shown there a solution which is always posi- 
tive exists, as long as 7) does not exceed a critical value r,*. Since 
there are two values of x, there are two such solutions. 

Formally the same procedure may be applied for x? < 0. In that 
case the Bessel functions have an imaginary argument. Again we 
find that only the centrally symmetric solution, represented by 
J (x, r) satisfies the boundary conditions. For an imaginary argu- 


ment this term reduces to (sinh «x 7)/r multiplied by a complex co- 
efficient. Since AS, (x 7), where A is any real or complex number; 
also satisfies the differential equation which is satisfied by J, (kata) 
therefore, by a proper choice of a complex A the solution may be put 
into the form B (sinh « 7) /7, where B is real. This reduces again to 


the case studied previously (Rashevsky, 1938; 1948, chap. iv). 
It may, however, happen that equation (78) has two conjugate 


complex roots, so that 
e008)? (85) 


Again we have to consider only centrally symmetric solutions. 
The case is best studied by transforming equation (76) into polar co- 
ordinates, and omitting all terms containing derivatives with respect 


to ¢ and 6. 
If we make this transformation and introduce a new variable 


“= or, (86) 


equation (76) becomes: 
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d 
apa + pu=0. (87) 
dr* dr? 
As we have seen, any solution of 
d? 
“=u=0, (88) 
dr? 


where «? is given by (78), is also a solution of (87). 
The general solution of (88) is 


u=Asin«r+ Beos«r. (89) 


Whether « is real or complex, B = 0, because 6 = u/r must be finite 
for r = 0. When «? is given by equation (85), we have 


sin xr = sin ar cos ibr + cos ar sin iby = sin ar cosh br 

(90) 
+2cos arsinh br. 
This complex expression which satisfies (88) has no physical mean- 
ing. The real and imaginary parts taken separately do not satisfy 
(88). It can, however, be shown that they satisfy equation (87). 
Substituting sin ar cosh br into (87) we find: 


[at + bt — 6a2b? + B,(b2 — a?) + B.] sin ax cosh bx 
91 
+ [4ab (b? — a?) + 28,ab] cos ax sinh bu = 0. ot 
If (91) is to hold for any value of «, both expressions in brackets 
must vanish. 
The requirement that the second expression in brackets must 
vanish leads to 
6, = 2 (a? — b?). (92) 
The same requirement for the first expression, combined with 
(92), leads to 
16a7b? = 46, — B,?. (93) 
If, however, x? is given by (78) and is of the form (85), then we 
have, by equating the real and imaginary parts: 


By 25 Besa 
e—>h?= sf 4ab = \/48. — fi. (94) 


Equations (94) lead directly to (92) and (93). 
, Since sin ar cosh br + i cos ar sinh br satisfies (87) and, as we 
just have seen, sin ar cosh br does satisfy it, therefore, cos ar sinh br 


N. RASHEVSKY 173 


also satisfies (87). Hence the centrally symmetric solution in this 
case is given by 
sinarcosh br __ cos ar sinh br 


ea + B ¥ (95) 
li ap 


where a and b are determined in terms of f, and f. by equations (94). 
The solution for the outside medium, ®,, , is of the form As/ fee be. 
The coefficients A, B, A,, and B, are again determined as before 
(Rashevsky, 1938; 1948, chap. iv). 

The time dependent oscillating solutions, which are in general 
highly symmetric, are thus superimposed upon a centrally symmetric 
solution. The resulting distribution of concentrations is again asym- 
metric. Most complex structures may thus be obtained. However, 
since in general all oscillations are damped, the only configuration 
which may last indefinitely is the centrally symmetric one. If the 
damping for some of the oscillations is very small, the asymmetric 
distributions of concentrations which correspond to those oscillations 
may persist for an appreciable time. 

The following remark is noteworthy. If we make @,, = ad.. = 0 


and @,. = — ds, , in equations (1) the reactions, in the absence of any 
diffusion, are described by the system 
dc, dC. 

Tee lg eee Qy0C1 « (96) 

This system (96) has an undamped periodic solution with the 

frequency di.. Yet even with @,, = dy» = 0; A. = — d»,, all oscilla- 


tions of the general solution of the diffusion equation are again 
damped. This seems to indicate that the damping is caused largely by 
the process of diffusion itself. It would make somewhat unlikely the 
possibility that the introduction of non-linear reaction equations, 
which may have periodic solutions that are always undamped (Lotka, 
1925; Volterra, 1931; Morales, 1944), may lead to undamped oscilla- 
tions in the solution of the general diffusion problem and thus lead to 
permanent stable but highly complex configurations within the cell. 
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The kinetics of the blood coagulation system have been formulated 
and an expression obtained for the “prothrombin time” in terms of the 
concentrations of the components of the system. A linear plot of data 
obtained from plasma dilution curves gives the values of the parameters 
of the system, and yields a mathematical method of comparing relative 
thromboplastin potencies. The analytical expressions given lead to the 
proper choice of thromboplastin potency and plasma dilution for mini- 
mum error in the clinical determination of prothrombin. 


In spite of the many theories which have at one time been in 
vogue, it is generally agreed today that the coagulation of blood oc- 
curs in two distinct, consecutive phases, viz., 1: The formation of 
thrombin, (7), from prothrombin, (P), and 2: The conversion of 
fibrinogen, (F'), to fibrin under the influence of thrombin. It is also 
generally agreed that ionic calcium must be present in the system. 

The exact role of calcium, and the mechanism of the first phase, 
have been the subject of much controversy and confusion. Early 
observers held to the idea that calcium alone, or calcium and throm- 
boplastin, (Th), combined with prothrombin to form thrombin. With 
the isolation of prothrombin and thrombin in relatively pure states, 
it has become clear that these concepts are no longer tenable. J. Mel- 
lanby (1939), H. Eagle (1935), and others have shown that pro- 
thrombin gives rise to thrombin only in the presence of both calcium 
and thromboplastin. The amount of thrombin formed is independent 
of the amount of thromboplastin in the system, but directly propor- 
tional to the initial amount of prothrombin. H. Eagle has submitted 
evidence that thromboplastin is a lipoprotein and that this agent to- 
gether with calcium constitutes an enzyme which catalyzes the con- 
version of prothrombin to thrombin. 

There has been less controversy regarding the second phase of 
the clotting process. The evidence appears to indicate decisively that 
thrombin is an enzyme which converts the soluble protein, fibrinogen, 
into the insoluble form, fibrin. More recent work of J. Ferry et al 
(1947) supports the view that the process is a polymerization. It now 
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appears certain that the reaction is not proteolytic, as it was once 
thought, but there can be no logical objection to the concept that the 
role of thrombin is enzymatic. 

In view of the foregoing briefly reviewed evidence and respec- 
tive of J. Mellanby’s study (1939) of the thromboplastin-calcium 
equilibrium, we may with some confidence list the following points 
which constitute the qualitative basis upon which any adequate for- 
mulation of the kinetics of the process must rest: 


1. Calcium and thromboplastin form an active complex which 
is an enzyme and acts upon prothrombin with the resultant forma- 
tion of thrombin. 

2. The affinity of thromboplastin for calcium is great, but the 
combination is dissociable in the equilibrium sense. 

3. Once formed from prothrombin, thrombin catalytically con- 
verts fibrinogen to fibrin. 

4. The conversion of prothrombin to thrombin by the thrombo- 
plastin-calcium complex and the conversion of fibrinogen to fibrin by 
thrombin exhibit all the known properties of enzymatic reactions. 


It is pointed out here that the present scheme of blood coagula- 
tion is incomplete in the sense that it does not include those factors 
controlling the fluidity of blood in vivo. Also the multiplicity of fac- 
tors which have thromboplastic activity cause one to doubt the va- 
lidity of the point of view that thromboplastin is an entity. Finally, 
the work on “Ac-globulin” (Ware, 1947) may lead to some revision 
of the now accepted concept of prothrombin activities. However, the 
foregoing scheme is a fairly complete description of the sequence of 
events, particularly as they occur in vitro in the clinical determina- 
tion of prothrombin. 

The determination of prothrombin has steadily increased in im- 
portance in clinical medicine, especially in dicumarol therapy. Ac-- 
curate and consistent results are imperative and must finally be based 
on an understanding of the rate process. Indeed, the view has been 
expressed that if accurate prothrombin determinations are not avail- 
able, dicumarol therapy must be discarded. (Martin, 1947). The em- 
ployment of enzyme systems in clinical determinations is a common 
procedure. Thus far, however, the determination of prothrombin by 
the “one stage” method has remained in an empirical and somewhat 
unsatisfactory state. It remains for this system to be treated in ‘a 
quantitative manner and for the rate of the over-all process to be 
formulated on the basis of present information regarding the ¢on- 
stituents of the system.. It is the purpose of this paper to present 
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such a kinetic formulation, to examine the features of the resulting 
expression, and to compare the results of the mathematical treatment 
with experimental data. 


The series of reactions to be considered are as follows: 


Phat Can is Th’ 

Le Ths P 
— 

TheP She oT (1) 
— 

dF: <5 It 
== 

T-F od MST Gel ay Siem 


The mathematical description of this type of system involves 
great difficulty unless certain assumptions may be made. In fact, the 
exact solution is available only when each reaction is first (or pseudo- 
first) order. One stipulation which frequently can be made with a 
high degree of precision is that the entire system should be in the 
steady state. This assumption is particularly applicable to consecu- 
tive enzyme reactions, and when it can be made, a very powerful 
method is available in the form of the Christiansen formulation. (See 
Hammett, 1940). To exhibit the method let us consider the general- 
ized case 


kaa 
A FBS Xa C 
— 


ky 


k_2 
DARKS X, EE (2) 
— 


ke 


Kn 
Do Xa — aN 
— 


Kn 


Here the X; are unstable intermediates and are assumed to be in a 
steady state, i.e., the rate at which X; is produced in step 7 is equal 
to the rate at which it is consumed in the subsequent step. If the 
system is in the steady state, the net rates of all the steps are equal 
and are in turn equal to the over-all rate, V, of conversion of A and 
B to the final products M and N. Thus 
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Vy — Vig = Vq — Vig S10 Un — Vn = V, (3) 


and 
V=w,— wa(X1) == aps (AG) — W-»(X2) Ei wieehe 
(4) 
= Wn (Xie) —W-n » 
where the w’s are defined as 


w, =k, (A) (B) 


w.s4=k.«(C) 
W. = kz (D) 
Wr — ky (L) 


W»=kha(MyYW). 


The solution of this set of n equations is obtainable by determinants 
and may be put in the form 


See ee ae ee 
VL Wy SAW. 7 Wwe, WW +++*Wn 
aks: mS 1 Wn Es WrWn-1 **** We (5) 
V. we W_nW_(n-1) | W_nW_ rr) **** Wa 
V=\. V2. 


If the over-all system is irreversible, w_, = 0, the term V_ van- 
ishes. In our particular case this assumption has been made and is 
equivalent to the assertion that fibrin is not converted to fibrinogen. 
In view of the fact that fibrin is insoluble, this assertion is justified. 
The expression for V then takes the form 


— 
(6) 


WW +++ Wn 
W2W3 ++ Wn ae WW mae Wn > W_1W2W4 oe Wn = Gy = W_1{W_2 sh W-_(n-1) 


It will be noted that there are some special difficulties in the 
application of the steady state rate equation to the coagulation sys- 
tem, namely, that the thromboplastin — Ca** complex (Th’) is re- 
generated in the third reaction of equation (1) and that thrombin, 
although partially bound as the complex, (7'-F'), would be expect- 
ed to accumulate as the over-all reaction proceeds. The first difficulty 
is eliminated by making the assumption that the concentration of 
Th’ is given by the equilibrium value. The assumption is readily jus- 
tified on the basis of the previously mentioned affinity of thrombo- 
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plastin for Ca**. As regards the accumulation of thrombin, recent 
work of J. Ferry et al (1947) leads to the conclusion that the enzyme 
T is “carried down” with the clot. They have followed the time course 
of recoverable fibrinogen and such clot properties as opacity (asso- 
ciated with molecular weight), rigidity (associated with degree of 
cross linkage), tensile strength, etc. Their data show that the for- 
mation of a clot, which is taken as the end point in the determina- 
tion of clotting times, occurs at a relatively early stage when ~ 10 
per cent of the fibrinogen has been converted to fibrin. After clot 
formation has occurred, reaction in the clot continues as judged by 
the criteria mentioned above. The succeeding changes in opacity and 
rigidity show that even after all of the protein has been bound to 
the network (clot) the reaction proceeds to form additional cross 
linkages and more opaque structures. If the reactions which occur 
in the clot are due to the enzyme, thrombin, which is the only logical 
assumption, then these findings justify the portrayal of the last step 
as shown in equation (1) and the assumption that the subsequent 
reactions which occur in the clot, with the ultimate restitution of 
free thrombin to the system, are slow relative to the rate at which 
the clot is formed. 

Under the foregoing assumptions, the expression for V in our 
particular case becomes 


agit K, (Ca**) (P) (Th) (F) 
~ K,(P) (F) + K3(F) + K,(Th) (Ca**) ’ 


where the K’s involve only the individual rate constants of the sys- 
tem. This equation gives the rate of production of fibrin as a func- 
tion of the concentration of all components of the system. The next 
requirement is to obtain a relation explicit in time and in the con- 
centration terms. Of particular interest is the relation between the 
“prothrombin time” and the concentration of prothrombin. Integrat- 
ing equation (7) and solving for the time we obtain 


(7) 


1 ae 
t,=— + ——-— 
Keath Kal \@) 
K;,  K, (Th) (Ca**) ; 
ete ee (8) 


panko chars CE) 
K, (Ca) (Th) 
Ke a ; 


The above integration was carried out between the limits ¢t = 0 and 
t= t,, where t, is the time required for the amount of fibrin produced 


>— 
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to reach a(t, is commonly referred to as the prothrombin time). 
Further, the assumption was made that the steady state rate is con- 
stant, i.e., that the concentration of each component is constant dur- 
ing the time required for clotting and that a = vt. It is known that 
at the time of clot formation a/(F,) ~ .1, where (F,) is the initial 
concentration of fibrinogen and that (Ff) is not strictly constant. If 


this change is taken into account, we have 


= v and integrating 


between (Ff) ==-F,) at ¢= 0 and (fF) =") — @ at-t — 7, the 
result is that given in equation (8) except that K, is now given by 
K; K, (Fo) 


k,= > CO) (ih) 0G >. ae 
K, Ka ‘ yA dee aay ae 


from which it is seen that if a@/(F,) is small, 


log des Sa log [1 —a/(Fo)] ~ 4/(Fo) , 
(Fo) —a 

and K, reduces to that given in equation (8). In equation (8) the 
value of a is simply neglected relative to (F.); it is also necessary 
to neglect the amount of prothrombin converted to thrombin from 
t=0Otot—t,. Thus a is the amount of fibrin required to produce 
the clot or end point. Manifestly this quantity, and hence t, , will vary 
with conditions which determine the properties of fibrinogen such as 
rigidity, tensile strength, etc. 

From the equation relating ¢, and (P), it is expected that the 
plot of ¢, as a function of (P) will be a rectangular hyperbola with 
asymptotes parallel to the coordinate axes. It is thus seen that as 
(P) approaches zero, ¢, increases without limit. As (P) is made in- 
creasingly large, the slope 


diguinvtinKigag 1 
d( By ame Rhye 


approaches zero and ¢, approaches a minimum limiting value given 
by 1/K,. Observe here a point to be discussed later, viz., that from 
equation (8) the limiting minimum value of ¢, is inversely propor- 
tional to the concentration of thromboplastin and directly propor- 
tional to the amount of fibrin, a, which must be present at the end 
point. These results are certainly in general agreement with the 
characteristic shape of experimental curves, and the limits of t, are 
compatible with physical concepts. In order to compare the equation 
with experiment, we take advantage of the fact that if t, be plotted 
against 1/(P), the result should be a straight line of slope, K,/K,, 


JOHN Z, HEARON 181 


and ordinate intercept, 1/K,. A linear plot is also obtainable by 
plotting t,(P) against (P). It is of interest to compare both types 
of plot, since graphically the 1/(P) line tends to: group the high (P) 
values while the (P) line gives equally spaced ,values of (P) equal 
weight. In view of the manner in which Th is involved in the con- 
stants, K, and K,, it should be found that lines.from data obtained 
with higher levels of thromboplastin exhibit smaller slopes and in- 
tercepts. 
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FIGURE 1. The unit of (P) is 100 per cent normal prothrombin. The dimen- 
sions of K, and K,/K, are sec-1 and sec unit respectively. 


Figure 1 shows data from A. Quick (see Kracke and Parker, 
1940) from which it is seen that the foregoing remarks regarding the 
general shape of the curve are valid; also shown are the two linear 
plots of these same data. The agreement here may be regarded as 
quite satisfactory. Figure 2, from the paper of M. Hurn et al (1945), 
displays data obtained with two different thromboplastin prepara- 
tions, all other conditions being identical. Figures 3 and 4 show the 
linear plots of these data. It is clear that the higher level of Th 
(Thromboplastin “D’”) gives rise to the line of smaller slope and in- 
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FiGuRE 2. Data obtained with the thromboplastin “A” and “D” of Hurn et 
al (1945). Units as in Fig. 1. (One point, t = 118, (P) — .05 has been omitted 
from the “A” curve.) 
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FIGuRE 3. Linear plots of data from “A” curve Fig. 2. Upper curve is 
(P)t, vs. (P), 1/K, = 18.7 sec, K,/K, = 4.30 sec unit. Lower curve is t, vs. 
1/(P) 1/ K, = 13.4 sec, K,/K, = 4.81 sec unit. 


tercept as predicted. In view of the discussion to follow, it is of inter- 
est to point out that preparation “D” of M. Hurn et al was a commer- 
cial product designed to give Quick’s normal ¢, of 12 sec and that the 
parameters from Figures 2 and 4 check rather closely. Finally, Fig- 
ure 5 shows the fits of the experimental points to the theoretical 
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FIGURE 4. Linear plots of data from “D” curve Fig. 2. Upper line is (P) 4, 
vs. (P), 1/K, = 8.95 sec, K,/K, = 2.65 sec unit. Lower curve is h, vs. 1/(P), 
1/K, = 9.00 sec, K,/K, = 2.60 sec unit. 
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FIGURE 5. Computed theoretical curves. “A’’: 1/K, = 18.6 sec, K,/K, = 4.31 
sec unit (mean values from Fig. 3). “D”: 1/K, = 8.98 sec, K,/K, = 2.63 sec 
unit (mean values from Fig. 4). 


hyperbola computed from the parameters, K, and K,, of the linear 
plot. 

While these comparisons are apparently satisfactory in all cases 
and qualitatively the variation of the parameters K, and K, with 
(Th) has been correctly predicted, no data are available in which 
the value of (Th) was varied in a definite manner and data then ob- 
tained from which K, and K, could be determined. The values of 
K,, other things being equal, should be proportional to (Th), as pre- 
viously noted. Preliminary experiments designed to test this point 
have been carried out by the author and satisfactory agreement ob- 
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tained (Heaton 1944, unpublished). It should be mentioned, how- 
ever, that wide variations in (Th) cannot be tested due to the in- 
fluence of changes in ionic strength and possibly due to the presence 
of inhibitors in the cruder preparations. In this sense the afore- 
mentioned work is not yet entirely satisfactory. However, the value 
of K, is extremely useful and sufficiently accurate for comparing the 
potency of various thromboplastin preparations. 

When prothrombin times are determined on prothrombin de- 
ficient plasmas, the actual result obtained clearly depends upon the 
activity of the thromboplastin preparation employed. It is usual, for 
this reason, to employ preparation of similar or identical activity or, 
alternatively, to seek some means of interpreting the results in terms 
of those which would have been obtained with a preparation with 
which the clinician is already familiar (See Hurn et al, 1940). As 
has been seen the value of 1/K, may be obtained for any given prepa- 
ration, directly from the t, vs. 1/(P) graph. The ratio of two values 
obtained with different preparations is an index to the relative ac- 
tivities of the two preparations for, from equation (8) 


Kae ATR) S 
Ka (hie 


where K,, and K,. are respectively the values of. K, for preparations 
one and two and (Th), and (Th). the corresponding thromboplastin 
concentrations. This ratio gives a convenient numerical basis for 
comparing thromboplastic activity. Also, if a given value of t, is ob- 
tained with a thromboplastin preparation for which 1/K, and K,/K»y 
are known, the values which would have been obtained with any other 
preparation, for which 1/K, and K,/K, are known, may be readily 
computed from the expression relating to t, and (P). 


Bvidently.there.are many points which may now be discussed 
with some degree of precision in terms of the relation derived here. 
At this point only one or two will be mentioned. The general tendency 
has been, in-arranging the concentration of the various components 
of the test system for prothrombin determination, to employ a great 
excess of all.components except prothrombin in order that this may 
be the so-called “limiting factor” of the rate process. In principle 
this is sound, but it is practical only within limits. The distinct dis- 
advantage ‘of a-great excess of thromboplastin is readily perceived 
from the equations presented. It has been seen that the clotting time 
approaches a minimum value, 1/K, , which is determined by the level 
of thromboplastin. In fact, with the usual experimental set-up, clot- 
ting times:in-the ‘normal:range already approach the limiting time 
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rather closely and in the range 70-100 per cent normal (P), differ 
only by 3-5 seconds from the minimum possible time and the clotting 
time is virtually independent of (P). The logical manner in which 
to avoid the difficulty is obviously not to further increase (Th), but 
to decrease (P), decrease (Th), or both. 

This is most readily seen from the expression 


Kk, 1 
K,(P)’ 
which gives the difference between the observed time, ¢,, and the 
minimum limiting time, 1/K,. The value of K,/K, decreases with 
increasing (Th). Therefore, the limiting value, 1/K, , is more closely 
approached for a given value of (P) the higher the value of (Th), 
and is eventually reached experimentally at lower values of (P) when 
higher values of (Th) are employed. 

Along similar lines are the following considerations: It is evi- 
dent from the experimental curves as well as the analytical expres- 
sion that the slope of the ¢, vs. (P) curve, 


tie ret he el 
d(P) “Ky (P)”’ 


decreases with increasing (P) and that the slope at any (P) de- 
creases with increasing (Th). In regions of small slope, a given 
change in (P) is reflected as a relatively small change in t,. We may 
ask what variation in (P) may be detected if t, may be determined 
within prescribed limits. The answer clearly depends upon the level 
of (P) in question and the parameters, K, and K,. The matter is 
made precise as follows: Let us agree that two groups of determina- 
tions of t, are significantly different if their means differ by At} and 
impose the condition that this time variation shall correspond to a 
given variation in (P), say A(P). The ratio of these two quantities 
must satisfy the expression for the slope of the ¢. vs. (P) curve of 
the system employed. The required value of (P) follows at once and 
is seen to depend on the value of K./K;,, 


where (P)* is the required value of (P). Stated otherwise, having 
the value of K,/K, we determine the value of (P) at or below which 
we must operate in order that a difference in ©, which we must ac- 


t,—1/K,= 


+In general At will be 3/20 where o is the standard deviation of the sets 
of determinations. 
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‘cept, reflect a difference in (P) which we have agreed to accept. 
Experimentally, it is then Bey to dilute the plasma being in- 
vestigated to the point where (P) = (P)*. Also the loss in sensitivity 
which accompanies the use of too high (Th) at a given level of (P) 
is clear from equation (9). 

In summary, it may be said that the treatment given here of the 
kinetics of the reactions occurring in the coagulation process gives 
a basis to many empirical procedures already adapted and points out 
ways of improving such procedures. Certain procedures found useful 
clinically and previously carried out empirically, e.g., adjusting vari- 
ous thromboplastin preparations to the potency of a given one, de- 
termining the relation between the times obtained with two prepara- 
tions, etc., are greatly aided by the availability of the analytical ex- 
pression, or they may be done completely analytically. The bearing 
of this discussion on in vivo clotting is not readily assessed at this 
point. Certainly, however, the majority of the information available 
to date on the coagulation process was derived from systems of the 
type covered here. 

The author is much indebted to Dr. M. F. Morales for valuable 
criticism and discussion. 

This work was aided in part by a grant from the Dr. Wallace C. 
and Clara A. Abbott Memorial Fund of The University of Chicago. 
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In the usual experimental technique, the membrane permeability to 
water in the units of cm/sec is not measured directly. The quantity 
which is usually obtained may be considered to be a measure of a co- 
efficient of penetrability having the dimensions time/length. The pur- 
pose of this paper is to show that by introducing the bulk modulus of 
water, an expression is obtained from which it is possible to calculate 
the water permeability in the units of em/sec from the values in con- 
ventional units. 


The membrane permeability, hs, of a substance, S, is defined 
as the mass flowing across the surface per unit time, per unit area, 
and per unit concentration gradient. The dimensions of hs are thus 
length divided by time. This is not directly measured in the case of 
water. It is the purpose here to obtain a method of estimating the 
permeability of water, h,,, analogous to that for any other substance. 
What is directly measurable is the flow rate of water per unit area 
per unit pressure difference. If p. and p; are the external and inter- 
nal pressures in dynes/cm acting on a membrane of area A , then the 
inward rate of flow of water, Q. in cm*/sec, will be given by (Ra- 
shevsky and Landahl, 1940) * 


Quw=EA(Pe— Di), (1) 


where & is a coefficient for the given membrane which has the units 
sec/em. One might refer to & as the coefficient of penetrability of 
water since its units are not the same as those of permeability. The 
conventional laboratory units for “water permeability,” are u?/u?/ 
min/atmosphere pressure difference (u = micron, Lucké, 1940). Since 
the density of water is almost unity, the numerical value is unchanged 
if »? is replaced by micro-micrograms, though the dimensions are 
changed. If this change is made, the conventional values become 
measures of €. We shall write é* for the value expressed in laboratory 
units, although strictly u® should be replaced by micro-micrograms. 


* Attention is here drawn to an error in the units of £ in this reference, the 
dimensions of £ being time/length or sec/cm instead of cm sec as given there. 
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Then the “water permeability” in the above units, ¢*, can be con- 
verted to & in sec/cm from the relation 


E(cm- sec/em) = 1.67 X 10-7? &* (u3/u?/min/atm). (2) 


If we consider the pressure difference across the membrane as 
being due only to the solute concentration difference, c; — Ce in 
gms/cm?, then if M is the molecular weight of the solute, T the ab- 
solute temperature and R = 8.3 X 10° is the gas constant, 


RT 
BS SS cee WG GE) (3) 
Deo sy ( ) 


so that 
Qu =RTEA(e,—c¢.)/M. (4) 


The quantity RT £/M has the units of permeability (cm/sec) , but 
the concentration difference refers to the solute. 
The expression which defines h, is given by 


Q. = lh, A (Cee = Cen) (5) 


where Cye and c,; are the external and internal concentrations of 
water in grams per cubic centimeter. 

Consider the flow Q, as being due to a pressure difference 
(De — pi) = Ap which results in a difference in the concentration of 
water. If a pressure Ap is applied to a mass m, of water of volume 
V, there is a change in volume —AV given by 


AV =— VAp/M;, (6) 


where M; = 2.07 X 10°° dynes/em? is the bulk modulus for water at 
20° C and at one atmosphere. If p, is the actual density of water for 
a given set of conditions, 


pwV = constant , (7) 
and therefore 
A pw/pw = — AV/V. (8) 
Hence we have 
Ap=A pw Ms/pw = A pw Mz, (9) 


since py ~ 1. 

In the absence of a solute dp, = Ac,. But in the presence of 
the solute this is not correct. However, the component of Ac, which 
is given by Ap, in the general case is just the change in concentra- 
tion of water which is effective in producing a transport of water. 
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Thus we shall substitute (p. — p;) = Ap by MgAcy = Mg (Cwe — Cwi) 
from equation (9) into equation (1) and obtain 


Qw= & MzA (Cue —'C pi) (10) 
Comparing equations (10) and (5) we then obtain 
hw = Mz &/pw = Mz & cm/sec. (11) 


Thus if &* is the value of the penetrability in u?/u?/min/atm , hip can 
be obtained from 1.67 X 10-?2 X 2.07 X 10°° &* or 


hy» = 0.034 €* em/sec , (12) 


if we assume that the compressibility is still about the same in the 
presence of solutes. 

If both solvent and solute were dilute solutions, then Ac,/M, 
would equal 4c/M . Then converting &* in u3/y?/min/atm to (RT&/M) * 
moles water/u?/min/moles solute per liter would also give the per- 
meability h,,* in moles/u?/min/moles per liter which has the dimen- 
sions of length/time. Since water is not a dilute solution, we must 
take this into account to obtain h,,* by multiplying (RTé&/M) * by fif- 
teen, the ratio of compressibility (1/Mz) of water to that compres- 
sibility water would have if it behaved as a perfect gas at unit den- 
sity. The value of h in cm/sec can be obtained from h,,.* by multi- 
plying h,* by 1.67 X 10°. This is equivalent to the result obtained 
above. 

For a number of echinoderm eggs the values for hy calculated 
from equation (12) using data by B. Lucké (1940) lie in the range 
3 X 10° to 14 X 10° cm/sec while erythrocytes of ox and man have 
values of h,, about 0.1 cm/sec. The value of 3 or 4 X 10° cm/sec for 
Arbacia eggs may be compared with the values of the permeability of 
Arbacia eggs to some other substances. For ethylene glycol and glyce- 
rol the values of the permeability are 6 X 10-° cm/sec and 8 X 10° 
em/sec (Jacobs and Stewart, 1932). The permeability to oxygen has 
been estimated as being greater than or of the order of magnitude 
of 2 X 10-* em/sec (Rashevsky, 1940, p. 24). 

The author is indebted to Dr. J. Z. Hearon for reading and dis- 


cussing this manuscript. 


LITERATURE 
Jacobs, M. H. and Stewart, D. R. 1932. “A Simple Method for the Quantitative 
Measurement of Cell Permeability.” Jour. Cell. and Comp. Phys., 1, 71. 
Lucké, B. 1940. “The Living Cell as an Osmotic System and its Permeability to 


Water.” Cold Spring Harbor Symp. VIII, 123-182. 
Rashevsky, N., and Landahl, H. D. 1940. “Permeability of Cells, its Nature and 


‘s 


190° MEMBRANE PERMEABILITY TO WATER 


Measurement from the Point of View of Mathematical Biophysics.” Cold 
Spring Harbor Symp. VIII, 9-16. 
Rashevsky, N. 1940. Advances and Applications of Mathematical Biology. Chi- 
cago: University of Chicago Press. 


4 


a 


ys 
. oh 
tim 


ty] eV 4 


= 
iam 


. . 
: ars a Eis 


BULLETIN OF 
MATHEMATICAL BIOPHYSICS 
VOLUME 10, 1948 


ON THE THEORY OF BLOOD-TISSUE EXCHANGE 
OF INERT GASES: VI. 


VALIDITY OF APPROXIMATE UPTAKE EXPRESSIONS 


MANUEL F. MORALES AND ROBERT E. SMITH 


THE UNIVERSITY OF CHICAGO AND THE NAVAL MEDICAL 
RESEARCH INSTITUTE, BETHESDA, MARYLAND 


It is shown that the equation of inert gas uptake by a distinct 
parallel tissue-blood arrangement coincides, under certain conditions, 
with two formulations which neglect the possible existence of a blood- 
tissue barrier. The first of these approximations is the classic von 
Schrotter equation in continuous form, whereas the second is the em- 
pirical one frequently used by contemporary authors. The condition for 
coincidence is that the product of permeability and blood-tissue exchange 
surface greatly exceed the rate of blood flow to the tissue. It is difficult 
to examine this condition at present because of a dearth of gas perme- 
ability measurements and because apparently there exist no measure- 
ments of surface and flow on the same tissue. A compilation is made of 
such values as are available, and it is found that on the assumption that 
gas permeabilities are of the order of 1 < 10-3 cm sec-1, the conditions 
for neglecting the blood-tissue barrier may be met in many cases and 
certainly not met in many others. It is concluded that under these cir- 
cumstances the more exact equations, taking into account the barrier, 
should be employed, at least until precise independent measurements 
justifying the approximations become available. 


In a series of papers appearing during recent years, the present 
authors (1944a, 1944b, 1944c, 1945a, 1945b; hereinafter referred to 
as I, II, III, IV, and V, respectively) have endeavored to formulate 
a quantitative theory of inert metabolite uptake, taking into account 
all factors which in the light of present knowledge seem of first-order 
importance. No attempt has been made, however, to relate this de- 
velopment to more limited expressions, derived by other authors, in 
particular, to the early and classic one of H. von Schrotter (1906). 
It seems necessary to clarify the relationship at this time because at 
least some contemporary workers have regarded their von Schrotter- 
like expressions as conceptually different from ours. To anticipate 
the results of this paper, we shall say that in a “distinct parallel” 
system (IV), when the product of permeability and surface is much 
greater than the blood flow through a tissue, then the limiting form 
of our equation is essentially identical with the von Schrotter expres- 
sion. This is a straightforward mathematical fact. Whether or not 
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this limiting condition is actually attained in real systems is a dis- 
tinct question, and one which only experimental measurement can 
answer. In the authors’ opinion, existing data are inadequate for the 
decision, although experiments now in progress* seem very promis- 
ing. 

: There are possibly three fundamentally different arrangements 
of tissues with respect to the circulation (IV) ; of these, it will pres- 
ently be obvious that the von Schrotter treatment is applicable only 
to one, namely, what we have called “distinct parallel”. It is, there- 
fore, the simplest case of this arrangement which we shall choose in 
order to demonstrate the relationship between the two mathematical 
descriptions. In the original von Schrotter treatment the possible dif- 
ference in solvent power between the blood and tissues was neglected, 
but this is a matter easily corrected by dividing the tissue volume by 
a partition coefficient, a , which for inert gases is one or less than one. 


Blood Carrier 


TISSUE 


FIGURE 1. Model of a simple exchange system in which transport is via the 
vascular flow between the point of solute supply (e.g., the lung) and that of 
exchange (e.g., a tissue region of volume V and homogeneous with respect to its 


solution properties). In the von Schrétter case the barrier penetration factor hS 
is neglected. 


* Experiments by Dr. Falconer Smith and his associates, aimed at the meas- 
urement of h for radioactive inert gases (plasma membrane of myxomycetes), 
are currently being conducted at the National Institute of Health. 
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We shall treat, as usual, the uptake of an inert metabolite at 
some localized region in the circulation, assuming that all blood leav- 
ing this region is charged with metabolite at a constant concentra- 
tion, C. The problem will be to find the amount, ¢~, of this metabolite 
within a distant tissue region which is in diffusion contact with the 
blood (Figure 1). Let us denote by V, the volume of blood which 
flows through the tissue region in question during one circulation 
time, and by V the volume of the tissue. After the manner of von 
Schrotter (loc. cit.), we may now think of the transfer problem in 
the following approximate way: V, cm® of blood pick up V.C gm of 
metabolite at the uptake region, and this amount is distributed in- 
stantaneously between blood and remaining tissue in proportion to 
their volumes, i.e., a fraction Vo/(Vo + V/a), remains in the blood 
and a fraction, (V/a)/(V. + V/a) is allotted the tissue. The V» cm? 
of blood now return to the uptake region and become re-saturated, 
the net amount picked up at this time being just equal to that which 
it gave up to the tissue. The cycle is then repeated. It is easy to see 
that the amount of metabolite in the tissue after n cycles is, 


em=vel (Ton) + (Far) 


. V/o. . VC V/a . 
eile ileal ei)" 
Voor Jo a Vie a 

Expression (1) is essentially von Schrotter’s final result. For com- 
parison with our equations, however, a slight transformation is de- 
sirable. If we think in terms of an equivalent continuous circulation 
rate, R cm® sec", through the tissue, it is clear that the volume of 
blood which has passed up to the time ¢ is Rt; since V. cm* is the 
volume which passes per cycle, the number of cycles up to the time 
tis; 


(1) 


pate : (2) 

Vo 

Using (2), we may re-write (1) as 
¢(t) ath Glen): (3) 

a 
R ; <) 
= = Ee e ae sexeneal (4) 
k v, log. (1 Vv 


This same system may be treated more accurately by the simul- 
taneous solution of two differential equation (1, IV). We shall de- 
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note the permeability of the blood-tissue barrier by h, and the ex- 
change surface by S; 2 will be the average metabolite concentration 
along the capillaries, x, the average in the tissue, and x,, the con- 
centration of metabolite in the blood leaving the tissue region. Now 
x), of course, will lie between C and 2,, its exact value depending 
on the instantaneous concentration gradient along the capillary. We 
shall take into account the existence of this gradient only phenom- 
enologically, by assuming that over the course of the absorption, 


%=—C—f(C—x,); —f, constant. (5) 


Employing expression (5), the arterio-venous accumulation term, 
R(C — 2,), becomes (R/f)(C — x). In all past papers we have 
taken f = 1, whence the coefficient of (C — x) was to be interpreted 
as the rate of blood flow. It is clear that if other values of f are 
chosen, the original equations and solutions still hold, provided the 
“R” is reinterpreted as 1/f times the true rate of blood flow. For 
example, if x) is to be the arithmetic mean of C and x, , then f=—1/2, 
and #/f is twice the rate of blood flow. 

It is not difficult in certain restricted cases to set up the partial 
differential equations for this system and so to deduce the axial con- 
centration gradient theoretically. For example, if z measures dis- 
tance along a capillary axis, p measures the radial distance from the 
capillary axis, Cg(z, t) is the concentration of solute in the capillary, 
Cr(p,z, t) is the concentration of solute in the (assumed) homogene- 
ous tissue, D;, the diffusion coefficient in the tissue, and pp is the ra- 
dius of the capillary, then the governing equations are: 


0Cz 0Cz 
3 =F 5 — 22poh (Cg — Cr) , 
& 


with the boundary condition that, — D, (8Cr/ep) =h[(Cs—Cr(po)], 


and that C; remains finite as p > o. The advantage gained by at- 
tempting an exact solution of these equations may, nevertheless, be 
illusory, because there are available virtually no good measurements 
of the physical constants involved, and the detailed capillary geometry 
is much more complicated than this model suggests. 

Adopting (5) we may write the differential equations of the 
system as, 


Sura 4 ftuak Bun hs : 
as ap TaEy f = bg) a (Fo — ax) 5 | ok ies A) 
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Teh eo 
Vi, S(t — an). (7) 
The solution of equation (6) and (7 )cis.CL); 
ie SF = mn 7 a 
ho (t) == V site = VeC 1+ (aaa ekit — eket : (8) 
Viet k 
ee OT re wt |. | 
a | i ae es ee 
where, 
R hS ( aV, 
al Gera 
a he ee 4 S ee vil 
k== 3 s1ai|o+—(1+ )] 
at (10) 
RhS 
—A4 
fVoV 


The plus or the minus sign before the second term of equation (10) 
corresponds arbitrarily, to k, and k,. A comparison of (3) with (9) 
readily suggests that the physical assumptions which justify the von 
Schrotter expression, (3), are those which would cause one of the 
two exponentials in (9) to disappear. This reduction to one expo- 
nential could be effected by having k, = k.; however, it can be shown 
that this equality would require certain terms in (10) to assume com- 
plex values, which requirement would be physical nonsense. The sec- 
ond, and only plausible, method is to have one of the two absolute 
values of k, say k,, be much larger than the other, whereupon (9) 


becomes, 


V 
b(t) =—C (1 — e%) . (11) 
a 
For |k,| >> |k2|, it is apparent from (10) that, 
atl RhS 
[tees )| oo (12) 
Viol tent Vo V fVoV 


The structure of condition (12) suggests that it can be achieved either 
when R/f >> hS or R/f << hS. To show this more clearly, we shall 
adopt the following notation: Rk/f = X; hS = Y; (aV./V) = 7; and 
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in the event that X >> Y, the small quantity Y/X = «; in the con- 
verse case, X << Y, we have the small quantity, X/Y =. We may 
then write from (10), 


1 { 
MixSey) ae +Y¥(1+7) 
is (13) 
—x[1+20-netatnre | F 
1 | 
Weal Kamae Diop Bie Mee ec: 
| (14) 


2(1—7r) gd 
| 1+ (Lone he, es 


It can be stated on experimental grounds that we need not be con- 
cerned with values of r > 1. It will be noted that the special case, 
r = 1, is a critical one in both (13) and (14), but one which need 
not concern us here. When r < 1, it will be obvious to the reader 
from an inspection of expressions (13) and (14) exactly what nu- 
merical conditions are being assumed in retaining only the linear 


terms (in ¢ or 7) in the binomial theorem expansion of the radical, 
yielding, 


beats (15) 
when R/f >> hS, and 
b= =| ee ;when R/f<<hS. (16) 
Veuve. (1+ 7)? 


It is clear that (3) can be regarded as an approximation identical 
with (11) provided that we can show (4) to be essentially the same 
as (16). Exact coincidence cannot be expected because of the ap- 
proximations already made. Nonetheless, it may be shown graphic- 
ally (Fig. 2) as well as by expansion in a MacLaurin series that for 
0=rs 0.6, the coefficient of —R/V, in (16) is not appreciably dif- 
ferent from log.(1 + r). The identity of (4) and (16) is thus rea- 
sonably complete for this range of r if we assume, as in the past, 
that the average axial concentration gradient is such as to make 
f = 1. To summarize, then, if in the differential equations for a dis- 
tinct parallel system, (8), (9), it be assumed that, (a) there exists 
along the absorbing blood vessel a concentration gradient of the type 
f =1, (b) hS >> R (in such a way as to justify the expansion of 
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FIGURE 2. Graph to show approximate coincidence of the single exponent as 
derived in the von Schrotter theory (in(1+r)) and in the limiting case of the 
differential equation method. The coincidence in the physiologically important 
range 0 < r < .6 is seen to depend on f (see text), being best when f = 1, and 
increasingly poor as f decreases from unity. 


the radical in (14)), and (c) 0 S aV./V & 0.6, then the uptake as a 
function of the time is given by von Schrétter’s expression (3), (4). 

In the absence of suitable experimental values of h , we can only 
speculate about the plausibility of the condition, R/f << hS. Let us 
divide this inequality by Vz, the tissue volume, and assume that f=1. 
We may then fairly require that 


S a 

Vr ¢ ; are 

Rp h exceed at least 100 to justify (11) and (16). 
ie 


We have not found in the existing literature simultaneous meas- 
urements of blood flow and surface-volume ratios on any tissue. How- 
ever, it may be seen from the data gathered in Table 1 that the ratio 
in question may be expected to lie between the two extremes, 277 h 
and 460,000 h. The decision regarding the validity of the von Schrot- 
ter type of approximation is thus seen to depend on accurate values 
of the permeability of the plasma membrane to gases. Such values 
are not abundant. In early rough calculations we, as well as others, 
have assumed values of the order of 1 X 10° cm sec”. Under these 
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circumstances it is clear that the ratio mentioned above would be 
much less than the requisite 100. It is probable, however, that the 
permeabilities are larger than 1 X 10°. From Krogh’s measurements 
we (III) have calculated 7 X 10° and 3 X 10 cm sec for O, and 
CO. respectively through the lung barrier. Recently, V. Wartiovaara 


TABLE 1 


Blood Flow and Capillary Surface per Unit Volume for Various Tissues 


Blood Flow/Volume Surface/ Volume 
Tissue or Organ (sec-1) (cm) 

Guinea Pig Muscles: 

(esting) ox. once | ee | 350,02 (1) eee 

(MASSA oe) 5 ee, | ee ee cca eae 200. (1) 2 

(working) fs 3-9 2 ee eee |e ee ee 390) CL) eee aeeaaeen 

Cmaxdian ciretil a bio ee |e eee eee ee eee eee T50a( 1 eee 

(gastrocnemius) 202 ee ee ee eee eee’ 186-254 (2) .........-.. 

(masseter) treme ee eee teeter eee eae 304-50 71a(2)e ee 
Mouse Muscle: 

PASEPOCHEMIUS Sane ee de eee ce ee Oe ©, ener em | Se eee 486-640 (2) .........-.-. 

IMASSCCC Ts eee ee eee A shan sats eee eee ee ace 8 | ee (20-923 (2)ye eee 
Guinea Pig Fat: 

Fattfat tissuesss..4.4....08. See ee Se eee 2550) (CS) )ieeceerenees 

éantattissten! sae? oth ee 3 Ree ee eee ee 64.15(3) ee 
Frog Musclestu hee isi) oe eke ie oes eee Ae A eee Seen | eee ee 190° (i) eee 
Phorsel MUSChe ko too eee eee cise ee ec ence Oe ee ne oe es ZA (1) ae 
Dog Miu scle:s:<2)0% 28a | re ve eee | nee 590) C1.) <2 see 
EV EOLd et eins 2 ee eee il oats ee oe ee 0933¢(4) s2| a ieee ee 
KF LY yaaa ce ne | 02b;. (4) 23iSe eee eee 
LAVOE ose scsi cascdbo oma Matrernevaies on Crest 026,..006, 017% (4) 22 ee eee 
of 7 1G | Repeats 2 A ee O23 (A) soo oa| stoves aan ee a 
INGESTING Ss 2.-: eee ce.c ke ol ee eee 012. -.(4) 42<:|-3. eae ee 
Spleenik.isde).t 0 ee oe OO TH (A) ete ee 
Stomach = 93-2 hit. Soke ap Sees Bee O04 .(A4)..41.4) 23. 2a eee eee 
Hand 42.1; 4et2 206 2 eee a ae petcut 0022 G4) sce: es Be ee 


The numbers in parenthesis refer to authorship of data: 


(1) Krogh (1936) 

(2) Sjostrand (1937) 

(8) Gersh and Still (1945) 
(4) Best and Taylor (1943) 
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(1944) has measured the permeability of tolypellopsis for deuterium, 
and I. Holm-Jensen, A. Krogh and V. Wartiovaara (1944) that of 
certain plant tissues for various ions; all of these values are of the 
order of 1 < 10-° cm sec. Accepting 1 X 10-* as a round number for 
h, we see that the extremes of the critical ratio are .277 and 460 — 
values which straddle 100. It would thus appear that whereas in cer- 
tain cases the von Schrétter approximation might be quantitatively 
justifiable, in others it would be very poor indeed. Until tissue con- 
stants can be measured with greater precision, a preference must be 
given to the general differential equation formulations (I-V) which 
are capable of describing situations wherein penetration is strongly 
limiting, as well as those situations where this is not so. 


In emphasizing the clear priority of H. von Schrétter with re- 
gard to equations of the type of (3) and (4), it also seems oppor- 
tune to mention the important papers of T. Teorell (1937a, 1937b) 
on the kinetics of distribution of injected substances. So far as 
we are aware, Professor Teorell’s work is the first rational attempt 
to describe the whole-body distribution process by means of an ap- 
proximate system of differential equations. It is regretted that this 
paper had not come to our attention at the time the present work was 
begun. 


This paper was aided in part by a grant from the Dr. Wallace C. 
and Clara A. Abbott Memorial Fund of The University of Chicago. 
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